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ABSTRACT 


Plight  simulators  cost  less  to  operate  than  do  aircraft; 
estimates  range  from  5 to  20  percent.  Many  studies  have  shown 
that  skills  learned  in  flight  simulators  can  be  perform.ed  success- 
fully in  aircraft,  i.e.,  the  use  of  flight  simulators  for  training 
purposes  saves  flight  time.  The  critical  issue  is  whether  the 
amount  of  flight  time  saved  by  the  use  of  simulators  is  worth 
their  cost.  The  cost-effectiveness  of  flight  simulators  for 
training  has  been  demonstrated  only  in  a few  recent  studies  which 
report  that  the  procurement  cost  of  simulators  can  be  amortized 
in  a few  years.  Current  R&D  about  flight  simulators  centers  about 
the  need  for  motion  and  wide  angle  visual  display  systems.  Plight 
simulators  have  achieved  their  greatest  use  by  the  military  so 
far  in  undergraduate  flight  training.  Their  greatest  potential 
for  future  savings  lies  in  transition  and  continuation  training 
which  account  for  the  major  costs  of  military  flying.  Consistent 
methods  of  data  collection  and  cost  estimating,  not  now  available, 
are  needed  to  evaluate  the  cost-effectiveness  of  alternative 
flight  training  programs.  Including  the  use  of  various  types  of 
simulators,  part-task  trdlners,  new  instructional  strategies,  and 
the  like.  The  report  provides  a preliminary  cost  model  which 
identifies  the  data  needed  to  develop  cost  estimates  for  use  in 
cost-effectiveness  analyses  of  flight  training. 
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SUMMARY 


A.  BACKGROUND 

The  purpose  of  this  paper  is  to  evaluate  research  ana  develop- 
ment concerned  with  determining  the  cost  and  effectiveness  of 
flight  simulators  for  military  training/^^  Military  flying  costs 
were  about  $2.7B  for  6.^M  flying  hours  in  PY  1975*  Flying  hours 
are  being  reduced  by  an  amount  expected  to  reach  17  percent  in 
PY  1981.  The  DoD  now  spends  about  $300M  per  year  to  procure 
flight  simulators;  the  total  for  PY  1975-1979  is  estimated  to 
be  about  il.5B.  If  flying  costs  ($2.7B)  are  actually  reduced 
by  25  percent  ($675M),  the  procurement  cost  of  these  simulators 
($1.5B)  could  be  amortized  in  2.2  years  (excluding  simulator 
operating  costs,  discount,  and  other  factors).  About  $28m 
was  allocated  for  RDT&E  on  flight  simulation  in  PY  1977. 

Flight  simulators  are  said  to  have  the  following  advantages: 
they  are  a convenient  means  for  instructing  and  observing  a pilot; 
they  provide  experience  with  extreme  conditions  not  often  encountered 
in  flight,  e.g.,  unusual  attitudes,  speeds,  controllability  condi- 
tions, and  malfunctions,  without  risks  to  safety;  they  provide 
automatic  recording  and  playback;  they  allow  objective  performance 
measures;  they  are  able  to  freeze  conditions  and  repeat  maneuvers 
not  possible  in  flight;  and,  in  addition,  cost  less  to  operate  than 
aircraft.  The  disadvantages  of  simulators  are  said  to  be  that 
they  may  not  adequately  duplicate  all  flight  conditions  and  that 
they  cannot,  in  any  case,  evoke  the  motivation  and  stress  provided 
only  by  actual  flight. 


B.  FINDINGS 
1 . Cost  of  Training 

Hourly  operating  costs  of  flight  simulators  approximate 
5 to  20  percent  of  the  hourly  operating  costs  of  the  aircraft  they 
emulate;  the  median  value  is  abouc  12  percent.  Although  the  data 
on  which  these  estimates  are  based  come  from  sources  that  may  not 
be  directly  comparable,  there  is  no  reason  to  doubt  that  simulators 
cost  much  less  to  operate  than  aircraft  and  that  their  use  could 
significantly  reduce  training  costs.  Whether  or  not  this  potential 
benefit  is  realized  depends  on  the  extent  to  which  skills  learned 
in  a simulator  carry  over  (l.e.,  transfer)  to  aircraft  and  save 
flight  time  otherwise  required  for  training.  Rates  of  transfer 
must  be  sufficiently  high  to  permit  the  total  cost  of  attaining 
a given  level  of  flight  proficiency  using  simulators  (or  some 
combination  of  simulators  and  aircraft)  to  be  less  than  the  total 
cost  incurred  by  using  aircraft  alone. 

The  military  services  do  not  appear  to  have  methods  useful 
for  estimating  costs  of  new  options  or  of  possible  changes  in  current 
flight  training  programs.  The  data  Systems  that  exist  are  generally 
limited  to  extracting  full  costs  of  given  training  programs  from 
base  accounting  systems  for  the  purpose  of  setting  rej-mbursement 
rates  for  Interservice  and  foreign  student  training.  Except  in  the 
area  of  flying-hour  costs,  there  is  no  attempt  in  these  systems  to 
associate  or  correlate  types  and  levels  of  resources  consumed  with 
increments  of  training  loads  or  with  particular  activities  within 
the  training  programs.  There  are  large  areas  of  commonality  in 
resource  requirements  between  flight  training  and  other  facets  of 
peacetime  military  operations,  (e.g,,  military  pay  and  allowances, 
base  support  personnel  and  services).  In  these  common  areas,  the 
applicable  data  seem  to  be  available.  However,  there  remain 
significant  resource-consuming  activities  that  are  peculiar  to  the 
training  establishment  for  which  requisite  iata  are  not  collected 
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(e.g.,  cost  loadings  for  instructional  personnel,  operating  and 
support  establishment  for  training,  command  structure).  A pre- 
liminary model  emphasizing  analyses  of  cost-tradeoffs  between 
flight  and  simulation  has  been  developed  in  Volume  II.  The  model 
provides  a basic  structure  and  identifies  the  types  of  data  needed 
to  develop  parametric  estimates  of  training  costs. 

2.  Effectiveriess  of  Flight  Simulators 

The  effectiveness  of  flight  simulators  for  training  purposes 
is  supported  by  many  studies  which  show  that  skills  learned  in 
flight  simulators  can  be  performed  successfully  in  aircraft;  no 
studies  were  found  v;hich  show  that  simulators  are  not  effective 
for  training.  This  means  thar.  the  use  of  flight  simulators  saves 
flight  time.  This  is  a consistent  finding  of  studies  which  extend 
from  1939  to  the  present.  Positive  transfer  of  training  has  been 
demonstrated  for  almost  all  types  of  simulators  and  aircraft, 
maneuvers,  and  skill  levels  of  the  pilots.  Simulators  appear 
particularly  effective  for  training  on  tasks  where  success  depends 
on  following  precise  procedures  (e.g.,  instrument  flight,  approach, 
and  landing).  There  are  fewer  studies  on  the  effectiveness  of 
simulators  for  training  on  other  aspects  of  flight  (e.g.,  air-to- 
ground  attack,  air-to-air  combat),  largely  because  of  previous 
limitations  in  the  capabilities  of  simulators  for  these  types  of 
training.  Most  of  the  studies,  but  not  all,  involve  undergraduate 
flight  training. 

The  amount  of  flight  time  saved  due  to  training  in  a flight 
simulator  varies  widely  for  reasons  which  cannot  be  discerned  from 
the  available  studies.  Transfer  of  training  (or  flight  savings) 
has  not  always  been  measured  in  the  same  way.  Factors  believed  to 
influence  the  amount  of  transfer  Include  the  type  of  simulator, 
the  tasks  for  which  it  is  used,  the  experience  level  of  the  pilots 
and  the  instructional  strategy.  Systematic  studies  would  be 
needed  to  establish  the  applications  for  which  the  new,  advanced 
simulators  are  likely  to  be  most  effective.  Almost  no  attention 
has  been  given  to  incremental  transfer,  i.e.,  the  rate  of  improvement 
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with  additional  training,  a type  of  information  needed  to  determine 
when  it  becomes  more  cost-effective  to  train  in  aircraft  rather 
than  in  simulators.  Most  studies  on  the  effectiveness  of  flight 
simulators  do  not  consider  cost  factors. 

The  effectiveness  of  fll.-ht  simulators  can  be  measured  in 
other  ways  than  by  the  amount  of  flight  time  saved,  but  this  is 
rarely  done  systematically  and  objectively  in  flight.  Examples  of 
other  measures  of  effectiveness  are  the  quality  (or  precision)  of 
flight  performance  (after  a fixed  amount  of  simulator  and/or 
aircraft  time),  errors  (e.g.,  failure  to  adhere  to  specified 
procedures,  near-accidents  and  accidents),  and  pilot  acceptance  and 
morale . 

3.  Cost-Effectiveness  of  Flight  Simulators 

The  cost-effectiveness  of  flight  simulators  has  been  demon- 
strated only  in  a few  recent  studies.  A Navy  study  concludes  that 
the  new  P-3C  flight  simulator,  when  used  for  transition  training 
of  about  200  Naval  pilots  a year,  saves  enough  flight  time  to  be 
amortized  in  about  2 years.  A Coast  Guard  study  concludes  that 
its  new  simulator,  used  for  transition  and  proficiency  training  of 
about  500  pilots  per  year  for  the  HH-52A  and  HH-3F  helicopters, 
can  be  amortized  in  about  2 years.  Initial  results  in  an  on- 
going Cost  and  Training  Effectiveness  Analysis  (CTEA)  by  the  Army 
suggest  that  use  of  the  r )w  CH-47  simulator  for  transition  training 
should  save  about  $8,000  per  pilot.  An  analysis  provided  by  a 
commercial  airline  indicates  that  its  simulators  can  be  amortized 
in  less  than  9 months  and  the  entire  training  facility  in  less 
than  2 yea^s.  The  cost-effectiveness  of  flight  simulators 
claimed  in  all  of  these  studies  appears  to'  have  resulted  from  the 
Introduction  of  both  an  advanced  simulator  and  improved'  instructional 
procedures.  There  is  no  way,  in  any  of  these  studies,  to  separate 
the  contribution  of  the  simulator  from  the  contribution  of  the  new 
way  in  which  it  was  used. 


4 . Improvement  of  Flight  Simulators 

Advanced  flight  simulators  have  only  recently  become  available 
to  the  services  for  use  either  in  experimental  or  operational 
studies  of  training.  Major  attention  has  been  given  to  the  need 
for  platform  motion  in  new  flight  simulators.  Findings  from  a 
series  of  studies,  some  of  which  are  still  unpublished,  indicate 
that  there  is  no  difference  in  the  flight  performance  of  pilots 
trained  in  simulators  with  or  without  platform  motion.  The 
finding  appears  to  hold  for  Inexperienced  and  experienced  pilots, 
for  training  on  basic  flight  and  cn  acrobatic  maneuvers,  and  for 
several  types  of  simulators.  The  finding  is  not  necessarily 
universal.  It  has  been  observed  primarily  with  undergraduate 
pilots  flying  a center-thrust  airplane  on  a simulator  with  a very 
wide  field  of  view  visual  display  (but  also  for  a two-engine, 
l.e.,  non-center-thrust  airplane  and  on  a simulator  without  a 
visual  display).  Different  time  delays  in  the  motion  and  visual 
systems  on  ASUPT,  the  simulator  used  in  some  of  the.se  studies,  may 
have  influenced  the  particular  results  obtained  with  that  device. 

The  ASUPT  motion  system  is  being  improved  and  new  tests  are 
scheduled  to  replicate  the  ini-ial  findings.  The  findings  do  not 
necessarily  apply  to  simulators  used  for  training  on  multi-engine 
aircraft  (e.g.,  asymmetric  thrust  conditions)  or  at  extreme  flight 
conditions  where  motion  cues  may  prove  to  be  significant.  Additional 
studies  of  motion  are  now  underway  or  planned  and  a more  complete 
understanding  of  what  platform  motion  contributes  to  training  will 
soon  be  available.  It  is  important  to  sort  out  the  influence  of 
motion  cues  in  simulators  due  to  maneuvering  the  airplane  from 
chose  due  to  turbulence  or  equipment  failure.  Some  studies  will 
consider  the  need  for  other  motion  cues  (e.g.,  g-suit,  g-seat, 
dynamic  shoulder  straps)  and  the  relation  of  motion  cues  to  visual 
cues  (particularly  the  size  of  "wide  angle"  field  of  view  displays). 
That  platform  motion  tends  to  improve  performance  in  the  simulator 
has  long  been  known;  the  fact  that  simulator  motion  does  not 
contribute  to  flight  performance  is  a new,  but  not  unanticipated, 
finding. 
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visual  displays  are  needed  In  simulators  for  training  in  such 
critical  maneuvers  as  landing,  air-to-ground  attack,  aerial 
refuelling,  and  air-to-air  combat.  Few  studies  are  now  being 
conducted  on  the  contribution  that  the  new  visual  systems  make  to 
training  or  on  the  characteristics  such  systems  must  have  in  order 
to  be  effective  for  training  or,  even  if  they  are  effective,  whether 
they  are  worth  their  cost.  An  advanced  visual  sytem  can  cost  from 
5 to  10  times  as  much  as  the  motion  bases  now  receiving  so  much 
attention  and  up  to  half  the  total  cost  of  a modern  flight  simulator. 
Although  R&D  on  visual  simulation  is  not  being  neglected,  most  of 
the  effort  is  directed  towards  the  development  of  equipment  rather 
than  towards  specifying  the  perceptual  requirements  that  such 
equipment  should  satisfy. 

Flight  simulators  are  primarily  teaching  devices  and  all 
advanced  simulators  have  features  that  can  influence  instructional 
strategies.  These  Include  objective  measurement  of  pilot  perform- 
ance; cueing  mechanisms  to  facilitate  learning,  playback,  problem 
freeze;  and  repeat  the  automatic  demonstration  modes.  Many  plans 
exist  for  R&D  on  the  optimum  use  of  these  features.  Unfortunately, 
studies  on  instructional  strategies  tend  now  to  have  a lower  priority 
than  studies  related  to  motion. 

5.  Future  Developments 

Most  R&D  on  flight  simulators  is  concerned  with  their  use  in 
undergraduate  training.  However,  this  type  of  training  accounts 
for  about  10  percent  of  all  variable  flying  costs  while  transition 
and  continuation  training  account  for  about  80  percent  (the 
remainder  is  for  support  flying).  (Transition  training  concerns 
learning  to  fly  aircraft  not  previously  flown;  continuation 
training  concerns  the  maintenance  of  combat  proficiency.)  The 
bulk  of  the  potential  payoff  of  flight  simulators  lies  in  these 
latter  types  of  training  and  not  primarily  in  undergraduate  training, 
and  future  R&D  should  concentrate  on  cost-effectiveness  of  simulators 
in  these  areas. 
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Consistent  methods  of  data  collection  and  cost-estimating 
should  make  it  possible  to  compare  the  cost-effectiveness  of 
alternative  training  programs,  including  explicit  evaluations  of 
different  configurations  of  flight  simulators,  other  training 
devices  (e.g.,  part-task  trainers)  and  alternative  instructional 
strategies.  Although  the  use  of  flight  simulators  appears  to'  be 
a way  of  reducing  training  costs,  the  more  fundamental  problem  is 
to  identify  where  and  how  their  use  is  most  cost-effective  (i.e., 
at  what  levels  of  training  and  for  what  types  of  aircraft,  combat 
missions,  and  flight  tasks  and  with  what  types  of  simulators  and 
instructional  strategies).  Resolution  of  these  problems  requires 
comprehensive  and  compatible  data  and  cost-estimating  methods 
that  do  not  now  exist  across  the  range  of  training  programs. 

The  services  are  also  using  different  strategies  to  procure 
flight  simulators.  The  Air  Force  plans  call  for  a large-scale 
procurement,  while  the  Army  is  following  a step-wise  approach; 
the  Navy's  plan  may  be  described  as  intermediate  between  these 
extremes.  Judging  which  type  of  program  is  most  appropriate  was 
beyond  the  scope  of  this  paper.  Yet,  it  is  clear  that  each  type 
of  program  has  some  advantages  and  some  risks.  If  flight  simulators 
prove  to  be  cost-effective,  the  Army  would  lose  savings  gained  by 
the  Air  Force  approach.  The  reverse  would  be  true  to  whatever 
extent  simulators  may  b found  to  be  not  cost-effective. 

If  the  increased  use  of  flight  simulators  leads  to  a reduction 
in  flying  hours,  which  appears  to  be  likely,  a fundamental  question 
will  have  to  be  answered;  namely,  what  is  the  minimum 
amount  of  continuation  flying  required  to  maintain  the  combat 
readiness  of  the  operational  flying  forces.  The  question  is  hardly 
a trivial  one.  It  includes  consideration,  not  only  of  maintaining 
flying  skills,  but  of  exercising  the  systems  which  support  military 
combat  flying  such  as  maintenance  and  repair,  logistics,  and  command 
and  control.  Although  there  is  concern  about  the  effect  that  an 
Increase  in  simulator  time  and  a decrease  in  flying  hours  could 
have  on  operational  readiness,  no  evidence  was  found  of  systematic 
efforts  to  establish  the  possible  impact  of  such  changes  in  objective 
terms . 
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C.  RECOMMENDATIONS 


1.  InoreaRed  emphaeie  should  he  given  to  ooet-effeotiveneeB 
analysed  of  all  aspects  of  flight  training.  This  includes  cost- 
effectiveness  evaluations  not  only  of  flight  simulators  per  se  but 
of  other  key  factors  in  flight  training  programs,  such  as  the  use 
of  part-task  and  cockpit  procedures  trainers,  the  major  components 
of  flight  simulators  (e.g.,  external  visual  displays,  platform 
motion  and  other  motion  cue  systems),  instructional  procedures, 
and  objective  performance  measures.  All  of  these  issues  must  be 
addressed  specifically  in  cost-effectiveness  analyses  of  under- 
graduate, transition  and  continuation  training  programs. 

2.  The  BoD  and  the  military  departments  should  develop 
mutually  consistent  data-collection  systems  and  cost-estimating 
methods  to  improve  their  capabilities  for  analyving  the  cost  and 
effectiveness  of  flight  training  programs.  The  preliminary  cost 
model  that  is  outlined  in  this  report  provides  a starting  point 
for  both  the  development  of  analytical  methods  and  the  identifica- 
tion of  data  that  should  be  collected.  Particular  attention  should 
be  given  to  identifying  the  consequences,  both  in  cost  and  effec- 
tiveness, of  different  inputs  to  training  programs  (e.g.,  aircraft, 
flight  simulators,  other  training  devices,  and  instructional 
strategies)  for  all  types  of  flight  training. 

3.  A DoD-wide  program  should  be  developed  for  RDT&E  on  visual 
systems  in  flight  simulators.  Emphasis  should  be  given  to  the 
development  of  specifications  for  the  visual  and  perceptual 
characteristics  of  such  displays  to  complement  the  emphasis  now 
being  given  to  the  development  of  improved  means  of  visual  simula- 
tion. Cost-effectiveness  analyses  are  needed  to  evaluate  trade-offs 
between  various  visual  specifications  and  engineering  specifications 
for  the  major  components  of  the  new  visual  display  systems 

(e.g.,  data  storage,  processing,  and  display.)  The  real  question 
is  the  contribution  which  any  improvement  in  any  of  these  components 
-might  make  to  the  cost-effectiveness  of  training  in  flight  simula- 
tors; this  question  is  both  obvious  and  overlooked. 
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Studies  should  be  performed  to  ii^entify  the  factors  which 
account  for  the  wide  range  in  amounts  of  flight  time  reported  as 
saved  due  to  the  use  of  simulators . Such  studies  should  be 
extended  to  Include  transition  and  continuation  training  that, 
together,  account  for  80  percent  of  variable  flying  costs  in 
peacetime . 

5.  Studies  of  the  effectiveness  of  flight  simulators  should 
be  designed  so  that  their  results  may  be  evaluated  on  a common 
basis.  In  practical  terms,  this  means  that  standard  measures  of 
transfer  of  training,  such  as  the  Transfer  Effectiveness  Ratio, 
should  be  used  in  all  studies  supported  by  the  DoD.  Further, 
these  studies  snould  uniformly  in-^estigate  the  manner  in  which 
transfer  of  training  varies  as  simulation  is  increasingly  substituted 
for  flying  (incremental  transfer  effectiveness)  to  establish  the 
limits  to  the  economic  use  of  simulators.  In  addition  to  studies 

of  flight  savings,  there  is  a need  for  studies  using  other  objective 
measures  of  the  effectiveness  of  flight  simulators,  such  as  their 
impact  on  the  quality  of  pilot  performance,  and  on  errors  and 
near-accidents  in  flight.  Systematic  studies  of  pilot  acceptance 
and  morale  should  also  be  included, 

6.  Establish  the  minimum  number  of  flying  hours  needed  to 
maintain  the  combat  readiness  of  the  operational  flying  forces. 

The  increased  use  of  flight  simulators  will  probably  lead  to  a 
reduction  of  flying  hours  needed  to  maintain  flight  proficiency, 
but  it  will  also  be  important  to  establish,  in  objective  terms, 
the  amount  of  flying  needed  to  maintain  readiness  of  support 
activities  such  as  maintenance,  logistics,  and  command  and 
control . 
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I.  CURRENT  USE  OF  FLIGHT  SIMULATORS 

A.  THE  USE  OF  FLIGHT  SIMULATORS  TO  REDUCE  FLYING  HOURS 

Various  types  of  flight  simulators  have  been  available  for 
training  since  soon  after  the  airplane  was  invented,  but  their 
actual  use  by  the  Military  Services  was  always  limited.  The 
reasons  are  quite  obvious:  the  simulators  did  not  simulate  airplanes 
very  well  and  pilots  preferred  to  practice  flying  in  airplanes 
rather  than  in  devices  anchored  to  the  ground.  The  situation 
has  changed  significantly  over  the  last  five  years  for  three  major 
reasons:  (1)  improved  simulators  are  now  more  acceptable  to  pilots, 
(2)  there  has  been  pressure  to  reduce  "unnecessary"  military  flying 
due  to  budget  constraints,  and  (3)  there  is  a need  to  conserve 
gasoline  due,  in  part,  to  the  oil  embargo  of  1973. 

Combat  flying  occurs  during  war.  In  peacetime,  military  flying 
occurs  for  the  following  purposes: 

Undergraduate  training  - Initial  flight  training 

Transition  training  - Training  to  qualify  for  flight  duty 

on  a different  type  of  aircraft,  after 
initial  flight  training;  also  called  type 
training  or  conversion  training;  Includes 
requalification  for  a pilot  who  loses 
"currency"  by  not  having  flown  that 
aircraft  for  some  time. 

Continuation  training  - Training  to  maintain  combat  proficiency 

of  pilots  and  flight  crews  assigned  to 
organizations  with  a primary  mission  of 
combat  in  the  event  of  conflict;  also 
called  operational  training. 
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Support  riying  - Includes  Military  Airlift  Command, 

industrial  fund  flying,  weapons  develop- 
ment and  test,  airborne  alert,  and 
command  support.  This  may  also  be  called 
mission  flying  (or  peactime  operational 
flying)  of  support  forces. 

In  its  most  recent  report  on  flight  simulation  to  the  Senate 
Ai’med  Services  Committee,  the  DoD  acknowledges  that  "the  planning 
goal  (to  reduce  total  flying  hours  by  25  percent  by  FY  I98I)  was 
not  based  on  formal  Service  or  Department  of  Defense  studies 
regarding  the  potential  for  reducing  flying  hours  through  the  use 
of  simulation."  (DoD  Report  on  Fl.ght  Simulation,  1977,  p.  21).^^^ 
Flying  for  undergraduate  pilot  training,  conversion  training, 
and  proficiency  flying  was  to  be  reduced  by  50  percent  and  for 
operational  training  by  20  percent  (current  terms  are  transi- 
tion in  place  of  conversion  training,  and  continuation  in  place 
of  operational  training;  the  term  proficiency  flying  is  still 
used  by  the  Army  but  no  longer  by  the  Navy  and  Air  Force.  The 
term  applies  to  flying  to  maintain  the  flight  skills  of  j-ated 
pilots  while  on  assignment  to  non-flying  duties,  i.e.,  "desk- 
type"  jobs.)  Additional  funds  for  flight  simulation  were  added 
to  the  budget  ($59M  in  FY  197^  and  $105M  in  FY  1975).  (Clements, 
197^)  Formal  guidance  was  given  to  the  services  in  1975 
(Planning  and  Programming  Guidance  for  FY  1977,  Secretary  of 
Defense,  February  1975). 

Military  flying  cost  about  $2.V3  for  6.4M  hours  of  flight 
in  FY  1975  and  an  expense  of  this  size  tends  to  be  noticed 
during  the  budget  reviews  of  the  DoD  and  the  Congress.  A 
Government  Accounting  Office  (GAO)  report  (1973)  noted  that  the 


(1)  Several  dates  may  be  found  for  the  time  at  which  the  planned 
reduction  will  be  achieved:  Clements’  letter  of  Feb.  20, 

1974  says  "in  the  next  five  years";  a staff  note  attached  to 
the  letter  says  "by  I98C";  the  DoD  Report  on  Flight  Simulators, 
February  1976  contains  no  date;  the  report  for  February  1977 
says  that  "the  end  of  FY  198I  was  an  Initial  planning  goal." 
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civilian  airlines  conduct  over  75  percent  (now  over  90  percent) 
of  their  flight  training  in  simulators.  (The  airlines  conduct 
transition,  upgrading,  and  recurrent  training.  Transition  training 
applies  to  qualification  in  new  aircraft  and  upgrading  for  a difer- 
ent  crew  position  in  the  same  aircraft.  Recurrent  training  applies 
to  periodic  recertification  to  insure  proficiency,  particularly 
on  abnormal  and  emergency  procedures.  The  airlines  do  not  conduct 
undergraduate  or  continuation  training  v/hich  account  for  about 
75  percent  of  all  military  variable  flying  costs).  The  GAO 
recommended  that  the  services  use  simulators  as  much  as  possible 
to  reach  and  maintain  required  proficiency  levels  and  that  they 
support  the  development  of  improved  simulators  to  replace 
maximum  amounts  of  training  time  now  spent  in  aircraft.  The 
Office  of  Management  and  Budget  (1973)  said  that,  based  on  the 
experience  of  commercial  airlines  and  the  manned  space  program, 
simulators  could  be  substituted  for  flight  with  substantial  economic 
benefits.  In  1976,  the  Senate  Armed  Services  Committee  expressed 
concern  that  the  use  of  simulators  as  a substitute  for  flight  might 
degrade  the  quality  of  the  flying  forces  (Senate  Armed  Services 
Committee  Authorization  Report  for  Fiscal  1976).  At  the  same  time, 
the  Conference  Comniittee  on  Appropriations  wanted  the  DoD  to 
increase  the  use  of  flight  simulators  and  to  integrate  them  into 
the  training  programs.  At  the  request  of  the  Senate  Armed  Services 
Committee,  the  DoD  provided  reports  on  its  flight  simulation  procure- 
ment program  for  FY  1976  and  FY  1977  and  on  its  R&D  program  for 
FY  1977  (Allen,  1976). 

The  use  of  flight  simulators,  some  still  to  be  procured, 
is  now  expected  to  reduce  total  flying  hours  by  17  percent  in 
FY  1981.  Not  all  aircraft  are  supported  by  simulators.  When 
flying  hours  for  all  aircraft  are  included,  it  is  estimated 
that  flying  hour  avoidance  will  be  about  11  percent  in  FY  1978 
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and  about  l4  percent  by  FY  198I.  It  appears  that  studies  which 
examine  the  various  consequences  of  such  reductions  in  flying 
hours,  both  on  training  programs  and  on  operational  readiness, 
remain  to  be  accomplished. 

B.  PROCUREMENT  OF  FLIGHT  SIMULATORS 

DoD  now  spends  about  $300  million  per  year  to  procure 
flight  simulators;  the  total  for  PY  1975-FY  1979  is  about  $1.5B 
(Table  1).  This  DoD  report  provides  amortization  data  for  2H 
types  of  simulators  (97  units)  authorized  or  requested  by  the 
services  during  FY  1976-1978;  the  sample  includes  mission  simu- 
lators, procedure  trainers,  and  instrument  flight  simulators. 
Median  amortization  periods,  to  the  nearest  half  year,  are 
shown  in  Table  2 for  two  discount  rates  (6  percent  and  no 
discount).  Based  on  the  DoD  estimates,  the  median  amortization 
period  for  these  flight  simulators  is  less  than  5 years  at  a 
6 percent  discount  rate  and  less  than  ^ years  with  no  discount. 
Department  of  Defense  Instruction  (DODI)  70^1.3  Economic 
Analysis  and  Program  Evaluation  for  Resource  Management 
specifies  that  cost-effectiveness  analyses  use  a discount  rate 
of  10  percent  which,  if  followed,  would  lengthen  the  amortiza- 
tion period  beyond  that  shown  in  the  report  to  Congress.  If 
military  flying  costs  ($2.7B  in  FY  1975)  are  actually  reduced 
by  25  percent  ($675M),  the  planned  procurement  cost  of  simulators 
($1.5B  for  FY  1975-FY  1979)  would  be  amortized  in  2.2  years. 

This  estimate  makes  no  allowance  for  the  costs  of  utilizing 
flight  simulators,  discount  rates,  and  other  factors  that 
should  be  Included  in  a full  life  cycle  cost  analysis. 

There  no  longer  appears  to  be  a question  about  whether  or 
not  simulators  should  be  procured.  Rather,  the  current  issue  is 
to  determine  for  what  purposes  and  to  what  extent  they  can  best  be 
used  and  what  performance  characteristics  they  need  to  meet  these 


TABLE  1. 

SYNTHETIC 

FLIGHT 

TRAINING 

DEVICE 

PROCUREMENT 

FUNDING, 

FY  1975 

-1979  (Dollars 

in  Mil  lions ) 

Aircraft 

System/ 

Approved 

Requested 

Simulator 

FY  l97S 

FY  1976 

FY  19T0 

FY  1977 

FY  1978 

FV  19! 

Army 

UH-1 

11.0 

17.0 

14.5 

8.2 

21.6 

AH-1 

- 

- 

- 

- 

- 

32.7 

CH-47 

- 

- 

- 

- 

16.4 

UTTAS 

- 

- 

- 

- 

- 

14.4 

TTTF 

TTTCT 

- 

TO~ 

8.2 

55T 

Navy/Marine  Corps 

A/TA-4 

3.2 

2.0 

0.3 

1.4 

0.6 

1.0 

A-6 

14.3 

2.8 

3.8 

6.6 

9.1 

9.4 

A-7 

4.8 

2.2 

- 

2.4 

3.1 

1.1 

CH-46 

5.0 

1.1 

0.1 

1.0 

13.4 

2.0 

CH-53 

- 

0.2 

0.1 

4.9 

0.8 

0.7 

E-2 

8.2 

1.0 

- 

2.0 

22.5 

4.5 

EA-6B 

15.1 

1.6 

0.1 

5.4 

4.5 

5.8 

EC/KC-130 

1.6 

2.2 

1.9 

1.5 

1.3 

1.9 

F-4 

9.1 

2.4 

1.3 

0.5 

0.8 

1.4 

F-14 

23.6 

5.5 

- 

15.7 

16.7 

11.8 

F-18 

- 

- 

- 

- 

23.1 

P-3 

8.2 

1.7 

6.4 

25.8 

20.9 

19.9 

S-3 

21.2 

15.9 

- 

1.9 

12.3 

8.2 

T-2 

3.2 

2.3 

- 

1.2 

0.9 

1.3 

T-34 

> 

0.8 

0.6 

- 

11.3 

0.8 

ACM* 

12.0 

- 

0.1 

1.0 

3.8 

'4.3 

Other 

3.9 

4.0 

5.0 

5.7 

8.5 

1.7 

73575" 

45.7 

19.7 

TTTlT 

190.5 

9575" 

Air  Force 

A-10 

.. 

13.2 

,1, 

22.1 

28.8 

10.0 

B-1 

- 

- 

- 

25.0 

47.0 

B-52 

1.0 

27.5 

31.1 

- 

- 

C-5 

3.0 

0.6 

- 

11.2 

- 

- 

C-141 

3.5 

2.5 

- 

9.3 

- 

- 

C-130 

15.0 

7.7 

- 

29.5 

50.1 

50.6 

F-15 

6.0 

17.2 

* 

19.- 

29.9 

21.9 

F-16 

- 

- 

- 

- 

38.0 

26.9 

F-111 

- 

- 

- 

9.9 

- 

- 

KC-135 

0.7 

17.1 

- 

24.3 

. 

. 

T-37/38  (UPT-IFS)  34.0 

39.5 

10.3 

52.9 

12.4 

- 

SEWT** 

- 

4.0 

- 

- 

- 

- 

5375" 

130 

TO 

2(50" 

150 

150" 

TOTAL 

207.7 

192.0 

30.0 

300.8 

322.9 

340.4 

* Air  Combat  Maneuvering  Simulator 

**  Simulator  for  Electronic  Warfare 

Training 

Source:  DoD  Report  on  Flight  Simulation,  1976,  1977 

t) 
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TABLE  2.  MEDIAN  AMORTIZATION  PERIODS  FOR 

97  UNITS  OF  24  SIMULATORS  AUTHORIZED 
OR  REQUESTED.  FY  1976  - 1978 


No.  of 

Simulator 

Types 


Median 

Amortization  Period 
6 percent  No 
Discount  Discount 


Army 

Navy/Marine  Corps 
Air  Force 


3 

12 

9 


4.5  years  3.8  years 
4.5  3.5 

6.  D 5.2 


Total  24 


4.8  years  3.8  years 


Source:  DoD  Report  on  Flight  Simulation,  1977 
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requirements.  Subsequent  chapters  of  this  report  review  informa- 
tion already  available  about  the  cost  and  effectiveness  of  flight 
simulators  and  consider  R&D  that  is  needed  to  deal  with  issues 
that  cannot  be  resolved  at  present. 

C.  UNDERGRADUATE  PILOT  TRAINING 

The  undergraduate  pilot  training  loads  of  the  military  services 
for  FY  1976-PY  1979  are  shown  in  Table  3-  The  training  load  is 
the  average  number  of  student  pilots  in  training  during  the  year, 
including  an  allowance  for  losses  due  to  attrition.  The  training 
load  (about  3000  in  PY  1978)  has  been  declining  since  FY  197^ 
but  will  rise  in  the  future  as  aviators  from  the  Vietnam 
period  leave  the  services  and  have  to  be  replaced.  Course  lengths 
and  anticipated  attrition  for  PY  1978  are  as  follows: 


Course 

Anticipated 

Length 

Attrition 

Army 

3I1-40  weeks 

10-25  percent 

Navy/Marine  Corps 

40-63  weeks 

15-30  percent 

Air  Force 

48.5  weeks 

13.5  percent 

Undergraduate  pilot  training  cost  about  $150K  per  pilot  in  FY  1975, 
according  to  a Defense  Audit  Report  (1976),  and  about  $125K  in 
FY  1976,  according  to  a Defense  Science  Board  report  (1976,  p.31)- 
It  is  by  far  the  most  expensive  type  of  training  provided  by  the 
Armed  Forces.  The  obligational  authority  for  flight  training  in 
FY  1977  was  $996M  for  5900  student  man-years  of  training,  l.e., 
load.  (Congressional  Budget  Office  1977?  p.9)*  Yet,  it  is 
important  to  remember  that  this  accounts  only  for  undergraduate 
flight  training  at  15  flight  training  bases,  i.e.,  "school  house 
training".  Most  military  flying,  such  as  for  transition  training, 
combat  training,  and  ^or  maintenance  of  readiness,  takes  place  in 
operational  units  and  is  not  reported  as  a cc  . of  training.  The 
distribution  of  variable  flying  costs  for  Vc.x  ious  types  of  flying 
shows  that  about  10  percent  is  for  undergraduate  flight  training 
and  the  remainder  for  other  types  of  flying. 
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TABLE  3.  TRAINING  LOADS,  UNDERGRADUATE  PILOT  TRAINING, 
FY  1976-79  AND  INPUT  AND  OUTPUT,  FY  1978 


ce:  Military  Manpower  Training  Report,  FY  1978 


Percentage  of  "'^ariable  Flying  Costs  (FY  I98I) 


Air  Force 


Navy 


Undergraduate  flight  training 

9% 

9% 

Transition/type  training 

11 

15 

Continuation  training 

75 

67 

Support  flying 

4 

9 

Total 

100% 

100% 

Sources:  USAF  Program,  Aerospace  Vehicles  and  Flying  Hours, 

Vol.  1,  7 May  1976  (SECRET) 

USAF  Cost  and  Planning  Factors  (AFR  173-10)  (CONF) 

Aircraft  Program  Data  File  (APDF),  Navy,  Jan.  1977  (SECRET) 
See  this  report,  Vol.  II,  Tables  1 and  2. 

D.  ADVANTAGES  OF  FLIGHT  SIMULATORS 

Flight  simulators  have  the  following  advantages  for 
training: 

1.  They  permit  full  attention  to  the  tasks  on  which  training 
is  to  occur  without  waste  of  time  on  tasks  directly 
relevant  to  that  purpose  (e.g.,  no  need  to  practice 
take-off  and  to  fly  around  the  airport  when  training 

for  landing  or  to  cruise  to  the  gunnery  range  when 
training  for  air-to-air  ground  gunnery.) 

2.  They  permit  observation  of  performance  by  an  instructor 
pilot  tnat  is  not  possible  in  a single-seated  aircraft. 

3.  They  provide  objective  measurement  of  performance  not 
ordinarily  available  in  most  aircraft. 

4.  They  provide  immediate  feedback  on  performance,  repeating 
trials,  and  freezing  the  status  of  the  airplane,  as 
desired  by  the  plan  of  instruction. 

5.  They  permit  scheduling  of  training  regardless  of  weather, 
air  traffic,  availability  of  aircraft,  targets,  ammuni- 
tion, fuel,  and  airspace. 


6.  They  provide  experience  on  dangerous  maneuvers  and  on 
flight  conditions  encountered  only  rarely  without  risk 
to  safety. 

7.  They  can  accommodate  advanced  instructional  methods,  e.g., 
simplify  a task  or  make  it  moi-e  difficult,  they  are  self- 
pacing, permit  computer-aided  instruction,  enable  desir- 
able sequencing  of  flight  tasks,  etc. 

8.  They  permit  rigid  control  of  flight  conditions  and  other 
factors  which  may  be  of  interest  for  training  or  experi- 
mental purposes. 

9.  They  permit  gradual  exploration  of  all  portions  of  the 
flight  envelope. 

10.  They  cost  less  to  operate  than  aircraft  (save  fuel  and 
ammunition,  extend  the  service  life  of  aircraft,  and 
avoid  accidents). 

In  short,  simulators  can  provide  certain  types  of  training 
more  effectively  and  less  expensively  than  aircraft.  The  major 
disadvantage  of  a simulator  is  that  it  is  not  an  airplane  and  it 
cannot  be  substituted  for  one.  Thus,  it  cannot  provide  the  stress 
and  experience  in  coping  with  unexpected  events  that  can  occur  in 
actual  flight.  No  serious  discussion  was  found  concerning  the 
disadvantages  of  flight  simulators. 

Pilots  are  not  known  for  their  enthusiasm  about  the  use  of 
flight  simulators.  In  1969,  an  Air  Force  Committee  reported  that 
"There  are  numerous  simulators  in  the  Air  Force  inventory  that  are 
not  fully  utilized  for  various  reasons.  This  may  stem,  in  part, 
from  the  lack  of  emphasis  placed  on  using  simulation  in  lieu  of 
flying"  (taken  from  Alsobrook,  1975,  p.3).  Alsobrook  found,  in 
a survey  of  about  450  pilots  and  navigators,  that  at  least  one- 
third  either  moderately  or  strongly  disliked  flying  the  simulator; 
tne  remainder  were  either  neutral  or  favorable.  Lack  of  realism 
and  inability  to  stimulate  the  feelings  involved  in  flying  are  given 
as  the  major  objections  to  the  simulators.  Youngling  et  al 
(1977)  report  that  pilots  would  be  willing  to  spend  about 
40  percent  of  thoir  flying  time  in  simulators  for  training 
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on  general  procedures,  instrument  flying  and  communications 
coordination,  but  20  percent  or  less  on  all  other  functions 
(e.g.,  takeoff,  landing,  air-to-air  combat,  air-to-ground 
attack).  Two-thirds  of  this  sample  of  about  375  were  pilots  with 
at  least  five  air  combat  kills. 

No  matter  how  wonderful  the  simulator  may  be,  a pilot  needs 
to  learn  to  fly  an  airplane  and  not  a simulator.  Thus,  the  Question 
about  how  best  to  train  a pilot  really  concerns  the  most  effective 
distribution  of  tasks  in  the  training  curriculum  between  the 
simulator  and  the  aircraft  for  producing  a qualified  pilot 
at  the  least  overall  total  cost.  The  policy  decision  that  flying 
hours  will  be  reduced  by  25  percent  and  hence  that  some  of  the 
training  accomplished  in  aircraft  should  be  accomplished  in  simulators 
is  not  as  radical  as  it  may  appear.  A certain  amount  of  training 
has  always  been  conducted  in  flight  simulators.  For  years,  test 
pilots  have  become  acquainted  with  the  flight  characteristics  of  new 
aircraft  in  simulators  before  taking  the  aircraft  off  the  ground  for 
the  first  time.  A well-known  example  of  total  reliance  on  flight 
simulators  for  training  is  the  case  of  the  astronauts  who  had  no 
previous  experience  with  orbital  flight,  rendezvous,  or  landing  on 
the  moon,  except  that  gained  (at  great  expense)  from  the  15  different 
simulators  used  in  the  Apollo  program.  Each  crewman  trained  for 
almost  1000  hours  (the  equivalent  of  tv/enty-five  ^0-hour  weeks)  in 
these  simulators,  most  of  the  training  (84  percent)  was  in  the 
command  module  and  lunar  module  full-mission  simulators.  (Wooding 
et  al,  1973).  The  training  program  for  the  crew  of  the  Space 
Shuttle  involves  the  use  of  11  simulators,  two  aircraft  modified  to 
simulate  some  flight  characteristics  of  the  Shuttle,  and  a KC-135 
to  provide  heavy  aircraft  training.  The  PAA  has  permitted  American 
Airlines  to  test  a transition  training  program  in  which  a pilot  flies 
a B-747  for  the  first  time  on  a regularly  scheduled  flight  after 
training  only  in  the  B-747  simulator.  A supervisory  pilot  monitors 
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the  pilot's  performance  until  he  is  judged  to  be  fully  qualified; 
the  pilot  cannot  be  considered  a novice,  since  he  is  already  fully 
qualified  in  the  B-707* 

The  GAO  (1973)  has  suggested  that  the  use  of  flight  simulators 
by  the  airlines  should  serve  as  a model  for  the  military.  Howevei*, 
the  circumstances  of  the  airlines  and  of  the  military  services  with 
respect  to  training  pilots  are  not  directly  comparable,  except  for 
the  transport  operations  of  the  Military  Airlift  Command.  Beyond 
that,  military  training  is  for  combat  operations  involving  the  use 
of  weapons  and  countermeasures  in  highly  maneuverable 
craft,  hardly  a task  for  the  airlines.  The  military  ser' ices 
conduct  undergraduate  pilot  training,  the  airlines  do  not.  Both 
conduct  transition  training  (i.e.,  upgrade  pilots  to  fly  aircraft 
not,  previously  flown),  refresher  training  (new  procedures  ani 
regulations)  and  recertification  (periodic  performance  evaluation 
and  quality  control).  Airline  pilots  fly  more  frequently  than 
military  pilots,  i.e.,  about  50  hours  per  month  (with  a maximum 
of  80)  in  comparison  to  5 to  10  hours  per  month  for  the.  military. 
Since  a commercial  flight  brings  in  money  to  the  airlines,  their 
pilots  are  encouraged  to  fly  up  to  the  limit  supported  by  the 
market.  A military  flight  appears  to  be  an  expense  to  the  tax- 
payer and  there  are  pressures  to  reduce  military  flying.  It  is 
helpful  to  remember  that  the  ultimate  purpose  of  military  flying 
is  to  assure  success  in  battle. 

Commercial  airlines  appear  to  use  their  simulators  more  exten- 
sively than  the  military  services,  perhaps  l8  to  20  hours  a day, 

7 days  a week  in  comparison  to  8 to  16  hours  a day,  5 to  6 days 
a week  for  the  military. 

In  addition  to  their  many  other  advantages  for  training  pilots, 
flight  simulators  can  be  operated  at  costs  that  appear  to  vary  from 
5 to  20  percent  of  the  equivalent  airplane  (this  topic  is  considered 
mere  fully  later  in  the  report).  This  does  not  mean  that  flight 
simulators  are  inexpensive  devices  either  to  procure  or  to  operate. 
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Helicopter  simulators  cost  from  4*1  to  $10M  each  (some  provide  four 
cockpits):  the  F-4,  C-5,  F-15  simulators  are  in  the  range  of  $3  to 
$7M  each,  excluding  the  cost  of  development;  the  Advanced  Simula- 
tor for  Undergraduate  Pilot  Training  (ASUPT),  an  experimental 
device,  cost  about  $2*1M  to  procure. 

An  estimate  of  how  much  it  costs  to  operate  a simulator  depends 
heavily  on  the  rate  provided  for  amortization  (if  relevant),  on 
the  assumed  student  load,  on  the  hours  of  utilization  per  week,  and 
on  the  manning  policies  associated  with  its  deployment.  An 
estimate  of  how  much  it  costs  per  hour  to  operate  the  comparable 
airplane  depends  not  only  on  its  amortization  schedule  (if  relevant), 
but  on  what  items  are  included  in  flying  costs  (e.g.,  fuel, 
maintenance,  spare  parts,  base  support,  etc.).  The  cost-effective- 
ness of  aircraft  and  simulators  depends  not  only  on  their  operating 
cost,  but  also,  clearly,  upon  how  they  are  used,  i.e.,  their 
effectiveness  as  training  devices.  We  should  anticipate  that  even 
though  simulators  generally  cost  less  to  operate  than  aircraft, 
they  may  not  always  be  so  effective  as  to  provide  a v^sost-effective 
alternative  in  all  applications. 

There  are  two  major  Issues  cbncerning  the  large  number  of 
flight  simulators  to  be  procured  by  the  Department  of  Defense: 

(1)  for  what  types  of  aircraft  and  for  what  types  of  training  are 
flight  simulators  more  cost-effective  than  aircraft,  and  (2)  what 
performance  characteristics  are  needed  to  make  flight  simulators 
cost-effective  for  various  types  of  training.  These  are  not 
trivial  issues.  The  major  application  of  flight  simulators  by 
the  military  services  has  been  for  undergraduate  pilot  training, 
followed  by  transition  training.  Yet,  over  50  percent  of  all 
military  flying  hours  and  65  to  75  percent  of  all  varlabl-*  flying 
costs  (varying  by  service)  are  for  continuation  training,  i.e., 
to  maintain  the  skills  necessary  to  perform  combat  missions. 

Thus,  the  appropriate  question  is  to  determine  the  extent  to  which 
flight  simulators  can  be  used  to  supplement  and/or  substitute  for 
all  types  of  military  flight  training,  and  not  only  undergraduate 
pilot  training. 
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The  performance  characteristics  of  flight  simulators  affect 
not  only  their  cost,  but  also  their  potential  effectiveness  as 
training  devices  for  the  many  different  skills  required  to  fly 
advanced  aircraft.  For  example,  platform  motion  and  visual  display 
systems  are  high  cost  items  in  the  flight  simulators  soon  to  be 
procured.  The  issue  of  what  they  contribute  to  training  is  discussed 
later  in  the  report. 

E.  RDT&E  ON  FLIGHT  SIMULATION 

About  $27M  (35  percent)  of  all  DoD  RDT&E  on  military  training 
($79M)  in  FY  1977  was  allocated  to  flight  simulation;  about  $1.7M 
was  allocated  to  RDT&E  on  the  cost-effectiveness  of  training; 
almost  none  of  the  latter  was  concerned  with  flight  training 
(Orlansky,  1977).  A few  cost-effectiveness  analyses  of  flight 
simulation  have  been  conducted  with  non-RDT&E  funds  by  operational 
and  training  coi.^uands  (see  Chapter  IV).  Current  policy  guidance 
of  the  DoD  calls  for  determining  the  cost-effectiveness  of  flight 
simulators  for  training  purposes  (SecDef  1977,  p.  III-88). 

About  half  the  RDT&E  on  flight  simulation  is  supported  by  the 
Air  Force,  followed  by  the  A -"my  and  Navy.  These  funds  were  expended 
for  the  following  categories  of  RDT&E  activities: 


6.1 

Research 

$ 0.2M 

1 

6.2 

Exploratory  Development 

2.0 

7 

6.3 

Advanced  Development 

8.7 

32 

6.4 

Engineering  Development 

12.9 

47 

6.5 

Management  and  Support 

- 

- 

IR&D 

Independent  R&D 

3.6 

13 

$27. 100  percent 

About  half  of  the  funds  are  spent  for  the  engineering  development 
(category  6.^)  of  prototype  components  and  subsystems  for  flight 
simulators;  a lesser  amount  is  spent  for  Exploratory  and  Advanced 
Development  (6.2,  6.3),  a pattern  generally  observable  in  most 
areas  of  technology.  The  small  amount  of  funds  for  Research  (6.1) 

in 


on  flight  simulation  warrants  notice  but  defies  explanation.  A 
more  detailed  review  of  the  RDT&E  activities  appears  in  Chapter  V. 


II.  OPERATING  COSTS  OF 
SIMULATORS  AND  AIRCRAFT 

The  case  for  flight  simulators  always  includes  the  arrument 
that  they  cost  less  to  operate  than  aircraft.  This  statement 
appears  to  be  correct,  even  though  data  to  support  it  are  incomplete 
and  have  not  been  collected  systematically.  More  reliable  infor- 
mation could  become  available  if  improved  procedures  are  instituted 
to  collect  cost  data  concerned  specifically  with  training  and  the 
use  of  flight  simulators.  The  current  situation  is  described  by 
the  following  statements: 

"The  data  base  for  simulator  cost  estimation  is  virtually 
nonexistent ... .A  study  to  develop  sound  models  for  cost 
benefit  analysis  of  simulator  capital  investment  decisions 
is  very  much  in  order.”  (Air  Force  Master  Plan,  i'^75, 
p.124) 

The  Defense  Audit  Service  (1976)  notes  that  the  military 
services  have  not  analyzed  their  allocation  of  resources  for  under- 
graduate flight  training: 

(1)  ”The  Army  had  acquired  2H  flight  simulator  cockpits 
without  preparing  the  economic  analysis  and  cost- 
effectiveness  studies  required  by  DoD  Instruction 
7041.3"  (p.23). 

(2)  "The  Navy  acquired  5 flight  simulator  cockpits  without 
preparing  the  required  economic  anaTvses  and  cost 
effectiveness  studies."  (p.24) 

(3)  "As  of  October  1975,  the  Air  Force  proposed  to  acquire 
24  Instrument  Flight  Simulator  Systems  consisting  of  96 
simulator  cockpits  at  a cost  of  $192  million  for  its 
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Undergraduate  Pilot  Training  Program  without  preparing 
up-to-date  economic  analyses  and  cost  effectiveness 
studies."  (p.2^4)^^^ 

It  is  not  a -trivial  matter  to  establish  operating  or  3ife-cycle 
costs  to  be  used  in  cost-effectiveness  studies  because  the  result 
depends  significantly  on  the  treatment  accorded  to  such  fact^■'rs 
as  base  support,  depreciation  of  aircraft,  aircraft  attrition, 
amortization  of  investment  in  flight  simulators,  utilization  rates, 
maintenance,  and  repair  requirements. 

Data  from  a variety  of  sources  were  collected  to  establish 
an  order  of  magnitude  for  the  costs  per  hour  of  operating  selected 
simulators  and  their  counterpart  aircraft  (Table  ^).  Most  of  the 
data  come  from  Air  Force  sources,  but  Army,  Navy,  and  commercial 
sources  are  also  used.  The  apparently  simple  comparison  of 
operating  costs  presented  in  this  report  rests  on  assumptions  which 
are  best  made  explicit.  The  cost  of  operating  an  aircraft  is  taken 
as  the  variable  flying  cost  per  hour,  a value  which  can  be  compared 
to  the  cost  of  operating  a simulator  for  an  hour.  Only  costs 
attributable  to  operations  were  included;  amortization  costs  and 
crew  salaries  were  excluded.  Only  costs  based  on  how  aircraft  and 
simulators  were  actually  utilized  during  the  period  of  observation 
(FY  1975  and  PY  1976)  were  used;  no  estimates  were  made  about  what 
the  costs  might  be  under  some  assumed  standard  condition,  such  as 
flying  aircraft  for  700  hours  per  year  or  operating  simulators  for 
80  hours  per  week.  No  assurance  can  be  offered  that  data  taken 
from  different  sources  were  compiled  according  to  the  same  rules. 

No  assumption  was  made  about  how  much  training  is  provided  by  one 
hour  of  training  in  a simulator  or  in  an  aircraft  for  any  member 
of  the  air  crew.  Thus,  if  these  many  qualifications  can  be  accepted, 
the  data  apply  only  to  the  cost  of  operating  a simulator  or  an 

(1)  The  original  economic  analysis  in  "Mission  Analysis  on  Futvire 
Undergraduate  Pilot  Training  System,  1975-1990", 

AFSC-TR-72-001,  January  1972  appears  not  to  have  been  updated 
in  connection  with  this  proposed  procurement. 
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TABLE  4.  SUMMARY  OF  VARIABLE  OPERATING  COSTS 
OF  SOME  SIMULATORS  AND  AIRCRAFT, 

FY  1975  and  FY  1976 
(Data  in  Appendix  A) 


N 

Range 

Median 

Operating  cost  per  hour 

Simulator 

49 

$ 9 - $ 275 

$ 96 

Aircraft 

42 

$63  - $3610 

$1066 

Cost  ratio:  Simulator/aircraft 
operating  cost  per  hour 

33 

0.02  - 0.40 

0.116 
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airplane.  The  results  of  interest  are  summarized  in  Table 
details  appear  in  Appendix  A.  The  median  variable  operatirg  cost 
of  49  simulators  is  $96  per  hour;  and  of  42  aircraft  is  $1066  per 
hour.  The  median  cost  ratio  of  simulator/aircraft  operating  cost 
per  hour  for  33  cases  where  both  costs  were  available  is  0.II6. 
Excluding  the  three  largest  ratios,  all  remaining  ratios  (91 
percent)  are  0.24  or  less.  On  the  basis  of  operating  cost  alone, 
it  appears  that  it  costs  very  much  less  to  operate  a simulator  than 
an  airplane. 

These  values,  of  course,  say  nothing  about  the  capability  of 
these  various  simulators  for  training-  The  simulators  in  this 
table  vary  markedly  in  their  complexity  and  operating  cost.  Only 
a few  of  them  may  be  called  modern,  fully  capable  simulators, 
e.g.,  the  Navy  P-3C  (2F87F),  the  Coast  Guard  HH-52A  and  HH-3F 
(VCTS),  and  the  B-747  and  DC-10  simulators.  Even  if  it  takes  more 
time  to  train  on  a particular  take  in  the  simulator  than  in 
the  aircraft,  it  is  economical  to  do  so  up  to  the  point  determined 
by  the  simulator/aircraft  operating  cost  ratio.  It  is  a matter 
of  considerable  interest  that  few  data  are  now  available  for 
comparing  required  training  times  for  various  tasks  in  the  simulator 
and/or  the  aircraft  and,  as  well,  for  comparing  those  results  with 
the  appropriate  operating  cost  ratios. 

As  noted  above,  the  operating  costs  of  the  flight  simulators 
shown  in  Figure  1 are  based  on  actual  rather  than  on  theoretical 
utilization  rates.  For  a limited  sample  of  38  simulators,  utiliza- 
tion varied  from  14-99  hours  per  week  with  a median  of  37  hours; 
the  median  operating  cost  was  $88  per  hour.  Assuming  a standard 
utilization  rate  of  80  hours  a week  for  all  simulators,  the  median 
operating  cost  of  the  same  simulators  would  be  $36  per  hour;  however, 
this  estimate  does  not  take  account  of  such  factors  as  increased 
manning  and  maintenance  which  would  occur  with  increased  utilization. 
In  the  airline  industry,  utilization  rates  of  flight  simulation 
are  estimated  to  be  100-125  hours  per  week. 


19 


^ comparison  of  operating  costs  is  based  on  the  premise  that 
the  services  have  (or  would  have)  purchased  aircraft  primarily  to 
accomplish  assigned  military  purposes  and  that  the  use  of  these 
aircraft  for  other  purposes,  such  as  training,  leads  to  the  accrual 
of  no  additional  costs,  except  those  due  specifically  to  training 
use.  Thus,-  all  costs  (investment,  OfiM)  are  excluded,  except  for 
the  variable  operating  costs  attributable  to  training.  Some  factors 
which  generally  favor  the  use  of  simulators  are  excluded  from  con- 
sideration. These  would  include  extending  the  useful  life  of  air- 
craft by  reducing  the  required  number  of  flying  hours  per  year  (or 
reducing  the  required  inventory  of  aircraft  by  an  equivalent  amount), 
reduced  attrition  of  aircraft  and  of  personnel  due  to  fewer 
accidents  with  reduced  flight  time  (unless  the  actual  trend  is 
in  the  opposite  direction),  need  for  fewer  airbases  and  less  air 
space  for  training  (if  the  reduced  number  of  flying  hours  and/or 
aircraft  are  in  large  enough  units  to  produce  such  effects),  and 
the  like. 

Advanced  simulators  will  have  greater  capabilities  and  will' 
probably  be  more  expensive  to  operate  than  those  in  current  use. 
(ASPT,  an  advanced  flight  simulato'r  with  special  features  needed 
for  experiments  on  training,  costs  $950  an  hour  to  operate;  this 
is  not,  of  course,  routine  training.)  Even  if  the  cost  ratios 
for  advanced  simulators  are  less  favorable  than  ^hose  shown  here, 
it  will  probably  still  cost  less  to  operate  a simulator  than  an 
airplane.  However,  operating  costs  (or  any  other  indicators  of 
cost)  are  not  by  themselves  very  significant  for  evaluating  effec- 
tiveness of  training  without  performance  measures  of  the  amount 
and  type  of  training  that  can  be  accomplished  either  in  the  simulator 
or  in  the  aircraft  that  are  being  compared.  It  is  conceivable 
that  a simulator  could  even  cost  more  to  operate  per  hour  than  an 
aircraft  and  still  be  cost-effective  for  certain  types  of  training. 
That  depends  on  Just  how  the  simulator  and  the  aircraft  can  be 
and  actually  are  used  for  training  purposes.  For  example,  it  may 
be  possible  to  perform  30  landings  an  hour  in  a simulator  but 
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only  six  In  an  aircraft;  it  may  be  possible  to  conduct  10  to  15 
air-to-air  engagements  with  "missiles*'  in  a simulator  per  hour 
but  only  five  without  missiles  in  the  air.  However,  effectiveness 
data  are  in  poor  supply  and  further  discussion  of  the  cost-and- 
effectlveness  of  flight  simulators  and  aircraft  is  not  warranted 
here.  On  cost  grounds  alone,  simulators  appear  to  be  a bargain. 
The  need  for  effectiveness  data  should  be  apparent. 


III.  EFFECTIVENESS  OF  FLIGHT  SIMULATORS 


A.  BACKGROUND 

Research  conducted  over  the  last  35  years  shows,  beyond 
reasonable  doubt,  that  flight  simulators  can  be  used  to  train 
pilots  and  other  crew  members  on  a wide  variety  of  flight  related 
skills.  This  research  has  been  reviewed  many  times  and  the  interested 
reader  is  referred  to  some  of  the  more  thorough,  recent  efforts: 

Smode,  Hall,  and  Meyer  (196?) 

Valverde  (1968) 

Carter  (1971) 

Micheli  (1972) 

Human  Factors  (1973) 

Johnson,  Knight,  and  Sugarman  (1975) 

Chalk  and  Wasserman  (1976) 

Caro  (1976,  1977a, b) 

Diehl  and  Ryan  (1977) 

Useful  information  may  also  be  found  in  the  reports  of  many  confer- 
ences on  flight  simulation  for  training,  such  as  the  nine  annual 
NTEC/Industry  Conference  Proceedings  and  the  AIAA  Visual  and  Motion 
Simulation  Conference  (1976). 

About  33  studies  which  show  that  flight  simulators  are  effective 
for  training  purposes  are  summarized  in  Appendix  B.  These  studies 
were  conducted  over  a wide  period  of  time,  1939  to  19.77;  the  list 
is  not  necessarily  complete.  The  summary  draws  primarily  on 
information  contained  in  Carter  (1971),  Micheli  (1972),  Diehl  and 
Ryan  (1977),  and  on  other  sources  identified  in  the  text. 

The  major  conclusions  that  may  be  drawn  from  these  studies 

are: 
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1.  Training  in  simulators  reduces  the  time  otherwise  needed 
to  acquire  the  same  skills  in  aircraft.  Many  well- 
controlled  studies  show  that  simulators  can  be  used  to 
train  pilots  on  flight  procedures,  takeoff,  approach 
and  landing,  flight  maneuvers,  and  instrument  flight. 

2.  Many  of  the  studies  used  college  students  to  show  that 
there  is  positive  transfer  of  training  from  simple  simula- 
tors to  simple  aircraft.  About  20  studies  since  1970 
show  similar  results  for  military  students  and  highly 
experienced  pilots  using  modern  flight  simulators  for 
current  jet,  turboprop,  and  helicopter  aircraft. 

3.  Plight  simulators  appear  to  be  most  effective  for  training 
on  tasks  that  involve  following  precise  procedures  such 

as  in  Instrument  flight  and  approach  and  landing. 

The  amount  of  transfer  of  training  from  simulator  to 
aircraft  varies  widely  among  these  studies.  Pew  of  the 
studies  report  the  amount  of  transfer  in  a consistent  way. 
Pew  studies  have  examined  systematically  the  factors  that 
influence  the  transfer  of  training.  However,  comparable 
measures  of  transfer  can  often  be  calculated  from  avail- 
able data  and  such  results  are  reported  below. 

5.  The  way  in  which  the  simulator  is  used  can  significantly 
influence  its  effectiveness  as  a training  device.  Among 
the  factors  known  to  Influence  training  are  the  training 
syllabus  Itself,  the  type  of  feedback  given  the  pilot, 
the  selection  and  training  of  instructor  pilots,  and  whether 
the  same  instructor  pilot  provides  training  both  in  the 
simulator  and  the  aircraft. 

Although  these  conclusions  are  regarded  as  well-founded,  they 
provide  only  limited  guidance  for  the  current  acquisition  and  use 
of  flight  simulators. 
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B.  MEASURES  OF  TRANSFER  OF  TRAINING 


The  term  "effectiveness"  must  be  taken  in  its  strict  literal 
sense,  i.e.,  that  simulators  can  be  used  to  teach  flying  skills 
that  transfer  to  the  aircraft.  The  question  of  whether  it  j,s 
economical  to  use  simulators,  i.e.,  cost-effective,  is  not 
considered,  in  most  of  these  studies,  a matter  which  is  discussed 
in  the  next  chapter.  For  example,  "Handbook  for  Training  Systems 
Evaluation"  by  Jeantheau  (1970)  does  not  consider  costs  of  training. 

Studies  of  effectiveness  completed  before  about  1970  were 
performed  on  sim.ulators  with  performance  characteristics  that  are 
obsolete  by  present  standards,  particularly  with  regard  to  vision, 
platform  motion,  and  instructional  features.  These  studies,  as  well 
as  many  more  recent  ones,  lack  a common  measure  of  the  effectiveness 
of  training,  that  is,  of  the  amount  of  training  carried  over  from 
a particular  simulator  or  method  of  training  to  the  aircraft.  Such 
a common  measure,  or  measures,  is  needed  to  compare  the  effects 
of  many  factors  that  may  influence  training,  such  as  the  design  of 
the  simulator  (e.g.,  its  motion  and  visual  systems),  the  way  in 
which  it  is  used  (e.g.,  instructional  features,  scoring  systems), 
and  even  who  uses  it  for  training  (e.g.,  undergraduate  and/or 
experienced  pilots). 

This  problem  was  noted  most  recently  by  Roscoe  (1971,  1972) 
who  proposed  that  certain  measures  be  used  systematically  to  estimate 
the  effectiveness  of  various  factors  which  might  influence  flight 
training.  Various  ways  of  measuring  transfer  of  training  have 
been  reviewed  previously  by  Gagne,  Foster,  and  Crosley  (19^8)  and 
Murdock  (1957).  We  found  several  closely  related  measures  to  which 
some  investigators  gave  different  names.  Without  adjudicating 
possible  claims  for  originality,  we  attribute  Percent  Transfer, 
Transfer  Effectiveness  Ratio  (TER) , and  Incremental  Transfer  Effec- 
tiveness Function  (ITEF)  to  Roscoe  (1971,  1972);  Replacement  Ratio 
to  Carter  (1971);  and  Flight  Substitution  Ratio  (FSR)  to  Diehl  and 
Ryan  (1977).  These  are  defined  below,  and  some  redundant  terms 
are  also  noted. 
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Percent  transfer  indicates  the  amount  of  time  saved  in 


inflight  training  due  to  the  simulator  and/or  other  training 
innovations,  e.g.,  revised  syllabus.  Carter  calls  this 
Replacement  Percent.  Diehl  and  Ryan  call  this  Percent 
Plight  Syllabus  Reduction.  Carter  uses  Percent  Transfer 
to  indicate  Improvement  in  performance  at  the  end  of  a 
fixed  amount  of  time  or  trials.  Percent  transfer  is  some- 
times called  Percent  Savings. 

Y - Y 

Percent  Transfer  = ^ x 100 

Y^  = time,  trials,  or  errors  required  by  a control 
group  to  reach  a performance  criterion. 

Y = the  corresponding  measure  for  an  experimental 

A 

group  which  has  received  prior  practice  on  another 
task. 


Traiisfer  Effectiveness  Ratio  (TER)  compares  the  flight 
hours  saved  to  the  time  spent  in  the  simulator.  Roscoe 
also  uses  ihe  term  Cumulative  Transfer  Effectiveness  Ratio, 
as  equivalent  to  the  TER.  Carter  uses  CTER  to  indicate 
Cumulative  Transfer  Efficiency  Ratio.  The  TER  is  the 
reciprocal  of  Carter's  Replacement  Ratio  and  also  (approxi- 
mately) of  Diehl  and  Ryan's  similar,  but  not  identical. 
Flight  Substitution  Ratio.  The  "Air  Force  Master  Plan — 
Simulators  for  Air  Crew  Training"  (1975)  uses  Training 
Transfer  Ratio  (number  of  hours  in  simulator/number  of 
hours  in  aircraft  for  equivalent  training). 
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Y Y 

Transfer  Effectiveness  Ratio  (TER)  = ^ — - 


Y^  = time,  trials,  or  errors  required  by  a control  group 
to  reach  a performance  criterion,  (same  as  Y 
above,  where  X = zero,  for  the  control  group) 

Y = corresponding  measure  for  experimental  group 
x 

receiving  x-training  units  on  a prior  task  (same 
as  Y above) . 

X = time,  trials,  or  errors  by  an  experimental  group 
during  prior  practice  on  another  task  to  achieve 
the  savings  represented  by  Y - Y . 

O A 

Incremental  Transfer  Effectiveness  Ratio  (ITER)  indicates  the 
efficiency  of  additional  amounts  of  training.  Carter  calls 
ITER  Incremental  Transfer  Efficiency  Ratio. 


time,  trials,  or  errors  required  to  reach  a 
performance  criterion  by  an  experimental  group 
having  received  Y-Ax  training  units  on  a prior 
or  interpolated  task. 

corresponding  measure  for  an  experimental 
group  having  received  X training  units  on  a 
prior  task  (same  as  Y above) 

A 

incremental  unit  of  time,  trials,  or  errors 
during  prior  practice  on  another  task. 


Incremental  Transfer  Effectiveness  Function  (ITEP) 

Y A Y 
_ X - Ax  - X 


27 


Replacement  Ratio  is  an  index  of  training  efficiency  used 
by  Carter  befoi'e  he  learned  about  the  TER,  of  which  it  is 
the  reciprocal. 


Replacement  ratio  = 


X„  “ time  required  by  the  experimental  group  in  the 

training  device  or  method  to  achieve  the  time  ranges 

represented  on  Y - Yp 

C b 

Y^  ® time  required  in  the  criterion  device  by  the  control 
group 

Y.,  “ time  required  in  the  crltei  j.on  device  by  the  experi- 
b 

mental  group. 


Flight  Substitution  Ratio  (FSR)  is  tlie  rate  at  which  flight 
time  is  being  replaced  by  simulator  time  and  reflects 
changes  in  both. 

Xr  - X 

Plight  Substitution  Ratio  (FSR)  * r~ 


Xr  “ time  required  in  simulator  by  experimental  group 

X^  “ time  required  in  simulator  by  control  group 

Y^  » time  required  in  aircraft  by  control  group 

Yr  » time  required  in  aircraft  by  experimental  group 

C.  FINDINGS  ON  THE  EFFECTIVENESS  OF  FLIGHT  SIMULATORS 

Standard  measures  of  transfer  of  training  tend  to  appear  in 
review  articles  and  infrequently  in  research  reports,  with  some 
recent  exceptions.  However,  they  can  be  calculated  easily  provided 
of  course,  the  required  data  are  reported;  namely,  the  hours  spent 
in  training  on  a particular  task  to  some  specified  level  of 


proficiency  in  a simulator  and  in  an  aircraft.  The  effectiveness 
of  flight  simulators  as  training  devices  was  calculated  for  three 
measures  of  transfer  of  training,  based  on  data  appearing  in 
reports  issued  from  1967  to  1977-  The  primary  source  of  much  of 
this  information  was  Diehl  and  Ryan  (1977),  whose  calculations 
were  verified;  original  sources  were  also  used.  The  three  measures 
were  Percent  Transfer,  Transfer  Effectiveness  Ratio  (TER),  and 
Flight  Substitution  Ratio  (PSR).  For  the  first  two  measures, 
larger  values  indicate  greater  effectiveness  for  the  simulator; 
for  the  FSR  (which  is  a reciprocal  of  the  TER  except  that  it 
explicitly  considers  savings  in  simulator  time),  smaller  numbers 
Indicate  greater  transfer,  i.e.,  that  use  of  the  simulator  increases 
(rather  than  decreases)  the  amount  of  time  needed  to  train  for  a 
task  in  the  aircraft.  Some  anomalies  due  to  the  way  in  which  the 
index  of  transfer  is  calculated  are  noted  below.  Diehl  and  Ryan 
(1977)  appear  to  be  the  first  to  use  the  FSR;  the  other  indices 
have  been  used  in  some  previous  studies. 

The  results,  shewn  in  Table  5,  are  clear:  with  a few  excep- 
tions to  be  noted  below,  simulators  are  effective  for  training 
purposes,  i.e.,  they  show  positive  transfer  effects  to  the  aircraft. 
The  use  of  flight  simulators  for  training  saves  flight  time. 

However,  there  are  wide  variations  in  the  effectiveness  of  different 
flight  simulators  and  of  the  same  simulator  when  used  for  different 
types  of  training.  The  information  shown  in  Table  5 may  be 
summarized  as  follows: 
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TABLE  5.  TRANSFER  OF  TRAINING  MEASURES, 

CALCULATED  FROM  REPORTED  INFORMATION 
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TABLE  5 (Continued) 
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Index 

Percent  Transfer  (percent) 
Transfer  Effectiveness  Ratio 
Flight  Substitution  Ratio 


Range 
-11  to  90 
-0.i<  to  1.9 
-8.0  to  H2 


Median 
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0.45 

1.25 


The  median  values  of  all  Indices  show  positive  transfer  but  will 
not  be  interpreted  further  because  of  the  wide  differences  in 
experimental  procedures,  tasks,  pilot  populations,  and  the  like. 
Clearly,  it  would  be  Important  to  understand  the  Influences  that 
account  for  large  and  small  amounts  of  transfer. 


These  three  indices  are  not,  of  course,  independent  measures, 
as  the  following  correlations,  based  on  Table  5,  show: 


Percent  Transfer  - 

Transfer  Effectiveness  Ratio 

Percent  Transfer  - 

Plight  Substitution  Ratio 

Transfer  Effectiveness  Ratio  - 
Plight  Substitution  Ratio 


T 

N 

0.49 

32 

-0.45 

28 

-0.22 

27 

The  negative  correlations  result  from  the  Plight  Substitution 
Ratio’s  reciprocal  relation  to  the  other  measures.  A crude  inter- 
pretation of  these  correlations  is  that  Percent  Transfer  provides 
about  the  same  ordering  of  results  with  respect  to  transfer  as 
would  either  the  Transfer  Effectiveness  Ratio  or  the  Flight 
Substitution  Ratio,  The  relationship  between  the  Transfer  Effec- 
tiveness Ratio  and  the  Plight  Substitution  Ratio  is  not  as  strong. 

Certain  types  of  training  can  produce  negative  results  (a  fact 
well  known  to  golfeis)  and  a few  such  instances  appear  in  the  table. 
Negative  PSR’s  are  shown  for  four  commercial  aircraft.  The  negative 
values  arise  in  the  computation  because,  due  to  improvements  in 
the  flight  curriculum,  fewer  simulator  hours  are  required  now 
(for  the  experimental  group)  than  previously  (for  the  control 
group).  Plight  hours,  of  course,  have  also  been  reduced.  The 
airlines  operate  a highly  effective  program  in  which  both  flight 
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time  and  simulator  time  have  been  reduced  markedly  over  the  last 
10  years.  This  suggests  that  the  FSR  can  give  a notably  misleading 
impression.  No  information  is  available  to  explain  the  other 
negative  measures  in  the  table. 

It  would  be  most  Interesting  to  be  able  to  explain  the  wide 
variations  in  the  effectiveness  of  flight  training  programs  suggested 
by  this  table  because  this  is  clearly  an  important  topic.  For 
example,  the  capability  of  the  simulators  used  in  these  studies 
varies  widely  with  respect  to  vision  and  motion.  The  visual  systems 
vary  in  field  of  view  (48°W  x 36°H  to  2^0^W  x 180°H)  and  in  how 
the  image  is  generated  (model  board  versus  computer-generated); 
some  simulators  have  no  visual  system.  The  motion  systems  have 
3 to  6 degrees  of  freedom,  while  some  have  none;  the  responsiveness 
of  the  drive  mechanism  (which  would  have  to  be  determined  in  each 
case)  is  at  least  as  important  as  the  number  of  degrees  of  freedom. 
The  way  in  vjhich  the  simulator  was  used,  e.g.,  type  of  syllabus, 
flight  task,  would  clearly  affect  its  potential  effectiveness. 

An  attempt  to  interpret  variations  in  the  effectiveness  of  flight 
simulators  on  the  basis  of  the  data  shown  in  Table  5 is  not 
warranted  and  could  not  be  accomplished  without  considerable 
additional  effort. 

Diehl  and  Ryan  (1977)  are  not  so  constrained,  and  we  report 
their  observations: 

• Simulators  provide  more  flight  savings  for  instrument 
flight  tasks  than  for  contact-type  tasks. 

• Commercial  airlines  have  achieved  more  flight  savings 
from  simulators  than  general  aviation  or  the  military. 

• Simulators  have  been  used  more  effectively  for  helicopter 
training  and  less  so  for  jet  and  transport  training. 

• Simulators  save  more  time  in  graduate  and  transition 
training  than  in  undergraduate  training. 

• Simulators  equipped  with  visual  systems  save  more  time 
than  devices  not  so  equipped  but  at  a lower  rate  of 
substitution. 
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• Simulators  with  high  fidelity  motion  systems  save  more 
time  than  devices  without  such  systems 

• Special  syllabi,  oriented  towards  the  flight  simulator, 
produce  greater  savings. 

• Part-task  trainers  used  with  new  simulators  lead  to 
greater  savings  and  better  substitution  ratios. 

These  observations  may  turn  out  to  be  correct,  but  they  are 
not  well  supported  by  currently  available  data.  Simulators  equipped 
with  visual  systems  cannot  properly  be  compared  to  those  without 
such  systems  because  they  are  not  used  for  the  same  purposes. 

Visual  systems  are  needed  for  training  in  such  tasks  as  landing, 
air-to-ground  attack,  and  air-to-air  attack;  systems  without  visual 
devices  are  useful  for  training  in  Instrument  flight,  navigation, 
the  use  of  radar,  and  have,  of  course,  been  used  to  train  in  blind 
landing.  Even  if  we  limit  ourselves  only  to  simulators  which 
have  visual  systems,  those  which  appear  in  Table  5 differ  notably 
in  their  visual  characteristics,  e.g.,  field  of  view  48°  x 36®, 

240°  X 180°),  scene  content  (i.e.,  model  boards  are  fairly  realistic, 
while  computer-generated  images  resemble  cartoons),  and  scope 
(model  bo.ards  are  limited  to  about  5 nmi  x 15  nmi  while  CGI  systems 
are  virtually  unlimited) . 

Nor  is  it  correct  to  say  that  simulators  with  high  fidelity 
motion  systems  save  more  flight  time  than  devices  without  such 
systems.  Current  research  results  indicate  that  no  differences 
can  be  found  in  the  flight  performances  of  pilots  trained  in 
simulators  with  or  without  motion  (the  studies  have  been  limited  to 
undergraduate  pilots  flying  center- thrust  aircraft  and  simulators 
equipped  with  wide-angle  visual  displays).  In  fact,  the  simulators 
in  Table  5 differ  in  having  3 and  6 degrees  of  freedom  and  it  is 
probably  correct  to  say  that  not  all  of  them  have  high-fidelity 
motion  systems.  Diehl  and  Ryan's  observations  are  best  regarded 
as  suggestions,  subject  to  verification,  for  establishing  the 
ways  in  which  simulators  can  be  used  most  effectively.  Simulators 
are  training  devices  and  we  should  expect  that  they  are  not  equally 
effective  for  all  types  of  training. 
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There  is  a wide  range  in  the  Transfer  Effectiveness  Ratios 
shown  in  Table  5-  The  TERs  alone  would  help  us  Identify  the 
types  of  tasks  for  which  any  simulator  may  be  a more  (or  less) 
effective  training  device  than  the  aircraft  itself.  But  additional 
information  is  needed  to  help  us  decide  whether  that  simulator  is 
also  more  (or  less)  cost  effective  than  the  aircraft  for  the 
particular  type  of  training.  Essentially,  we  have  to  compare  the 
TER  to  the  simulator/aircraft  operating  cost  ratio  per  hour  in 
order  to  decide  whether  to  use  the  simulator  or  the  aircraft  for 
training  purposes.  Table  5 does  not  provide  the  cost  data  needed 
to  make  this  type  of  decision.  In  interpreting  these  TERs,  it 
is  helpful  to  recall  that  most  current  simulator/aircraft  operating 
cost  ratios  appear  to  be  in  the  range  of  0.10  to  0.20. 

D.  INCREMENTAL  EFFECTIVENESS  OF  FLIGHT  SIMULATORS 

Although  one  continues  to  improve  with  additional  training, 
the  amount  of  Improvement  per  hour  o.'*  trial  would  be  expected 
to  decrease  as  training  progresses.  This  is  the  phenomenon  known 
as  the  learning  curve  (not  to  be  confused  with  the  production 
learning  curve,  which  shows  a similar  trend).  Thus,  although  it 
is  convenient  to  calculate  the  TER  over  some  portion  of  a training 
syllabus,  the  actual  value  can  be  expected  to  decrease  with  each 
additional  hour  or  trial  of  training  on  a specific  phase  or  level 
of  skill  acquisition.  This  implies  that  the  effectiveness  of  a 
flight  simulator  as  a training  device  would  be  greatest  at  the 
start  of  a given  type  of  training  and  would  decrease  as  that 
training  proceeds.  This  is  shown,  with  hypothetical  data,  in 
Figure  2.  Despite  diminishing  training  effectiveness,  it  is 
cost-effective  to  use  the  simulator  up  to  the  point  where  the  TER 
equals  or  becomes  less  than  the  simulator/aircraft  operating  cost 
ratio.  A discussion  on  the  conditions  for  the  efficient  allocation 
of  simulator  and  aircraft  hours  to  training  may  be  found  in 
Volume  II,  Appendix  A.^^^  Obviously,  it  becomes  Important  to  establish 

The  Incremental  transfer  effectiveness  function  and  the  product 

Isoquants  describe  related  but  not  identical  relationships. 
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TRANSFER  EFFECTIVENESS  RATIO  (TER) 


FIGURE  2.  Relationships  among  transfer  measures  based  on 
hypothetical  data  for  general  aviation  ground 
trainers  used  in  a ten-hour  flight  curriculum, 
(Source:  Roscoe,  1971) 
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the  shape  of  the  learning  curve  so  that  one  can  determine  the  point 
beyond  which  further  training  on  the  simulator,  although  perhaps 
effective.  Is  no  longer  cost-effective.  Cost-effectiveness  studies 
of  this  type  are  virtually  nonexistent;  an  exception  Is  the  study 
of  Povenmlre  and  Roscoe  (1973)  reported  In  the  next  chapter,  which 
determined  the  marginal  productivity  of  a flight  simulator  by 
means  of  the  Incremental  Transfer  Effectiveness  Ratio.  Thus,  the 
demonstrated  effectiveness  of  a flight  simulator  as  a training 
device  Is  a necessary  but  not  a sufficient  reason  to  Justify  Its 
use,  rather  than  that  of  the  aircraft,  for  training.  Obviously, 
we  also  need  to  know  the  simulator/aircraft  operating  cost  ratio. 

E.  FIDELITY  OF  SIMULATION  AND  EFFECTIVENESS  OF  SIMULATORS 

It  Is  often  assumed  that  Improved  fidelity  Increases  the 
effectiveness  of  flight  simulators  for  training  purposes.  The 
nature  of  this  relationship  is  explained  in  Figure  3>  where 
Johnson,  Knight,  and  Sugarman  (1975)  repeat  a figure  used  originally 
by  Miller  (195^).  That  training  requires  fidelity,  particularly 
high  fidelity,  is  a view  popular  with  pilots  and  manufacturers  of 
flight  simulators.  Since  improved  fidelity  increases  the  cost  and 
complexity  of  flight  simulators,  it  is  a subject  which  warrants 
discussion.  Note  that  the  beneficial  effect  of  increased  fidelity 
shown  by  Johnson  et  al  is  in  the  form  of  a hypothetical  curve 
because  little  useful  data  on  the  relationship  between  fidelity 
and  transfer  have  been  developed  since  Miller’s  original  paper. 

’’Fidelity”  of  simulation  is  generally  not  defined.  Let  us 
take  it  to  mean  the  accuracy  with  which  some  feature  or  response 
characteristic  of  a simulator  approaches  the  same  feature  of  the 
aircraft;  a more  precise  definition  would  distinguish  between 
engineering  and  perceptual  fidelity  and  propose  ways  of  measuring 
them.  We  see  immediately  that  fidelity  is  not  a general  character- 
istic of  a simulator  but  that  it  applies  separately  to  many  of 
its  details,  e.g.,  the  layout  of  instruments  and  controls  in  the 
cockpit,  the  nature  of  the  aerodynamic  flight  equations  and  data 
processing  that  determine  the  movements  of  the  instruments  and  the 
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forces  on  the  controls  during  various  maneuvers,  the  visual  and 
platform  motion  characteristics  of  tne  simulator,  and  so  on.  The 
type  of  fidelity  needed  3n  a simulator  is  obviously  related  to 
its  intended  use,  e.g.,  vision  is  needed  for  training  in  landing 
and  air-to-ground  attack,  but  not  in  instrument  flight.  The  required 
amount  of -fidelity  is  not,  as  yet,  readily  specifiable,  e.g.,  3 or  6 
degrees  of  freedom  in  the  motion  base,  size  of  the  field  of  view 
and  the  need  for  color,  rather  than  black  and  white,  in  the  visual 
system. 

There  are  two  criteria  that  may  be  used  to  define  the  fidelity 
required  in  a flight  simulator.  One  is  the  precision  with  which 
some  real  life  characteristics  of  flight  are  duplicated,  in  engineer- 
ing terms;  the  other  is  pilot  acceptance  or,  more  precisely,  its 
perceptual  equivalence  to  actual  flight.  It  is  reasonable  to 
believe  that  Improved  fidelity  of  flight  simulation  should  improve 
its  training  value.  Pilots  have  clearly  refused  to  accept 
simulators  that  have  "poor"  (i.e.,  nonrepresentative)  handling 
qualities  and  simulator  manufacturers  have  responded  strongly  to 
this  demand.  Thus,  there  has  been  a trend,  both  in  development 
and  procurement,  to  Increase  the 'fidelity  of  flight  simulators. 

But,  in  fact,  there  has  been  insufficient  research  to  examine  which 
types  of  fidelity  have  demonstrable  training  value  and  which  do 
not.  The  limits  of  this  argument  can  easily  be  set.  Prophet 
and  Boyd  (1970)  found  that  a simple  cockpit  mock-up  constructed  of 
plywood  and  photographs,  could  be  used  to  train  a pilot  in  cockpit 
procedures  just  as  well  as  a high  fidelity  trainer  (Device  2-C-9) 
or  the  actual  aircraft  (the  OV-1  Mohawk,  a twin-engine  turboprop 
Army  aircraft).  Dougherty,  Houston,  and  Nlcklas  (1957)  used  de- 
vices, ranging  in  fidelity  from  photographic  mock-up  to  the  air- 
craft itself,  to  train  pilots  in  flight  procedures.  They  found 
that  the  higher  fidelity  devices  produced  better  immediate  trans- 
fer than  the  lower  ones  but  the  performance  differences  almost 
disappeared  after  five  trials  in  the  aircraft.  Brown,  Matheny,  and 
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Plexraan  (1950)  placed  a perspective  drawing  of  a runway  on  a 
blackboard  in  front  of  a Link  trainer  as  an  aid  in  teaching 
landings.  The  experimental  group  made  fewer  errors  than  the 
control  group  in  learning  to  land  a light  aircraft.  \t  the  other 
extreme,  some  recent  studies,  discussed  earlier,  strongly  suggest 
that  pilots  trained  in  a modern  simulator  without  motion  can 
perform  acrobatics  and  other  maneuvers  in  the  air  just  as  well  as 
pilots  trained  with  motion. 

A motion  base  with  six  degrees  of  freedom,  such  as  used,  adds 
about  $300,000  to  t -.a  cost  of  a simulator  and  consumes  over 
100,000  watts  of  power.  Too  little  is  currently  known  about  how 
much  fidelity  is  actually  needed  for  training.  Clearly,  fidelity 
of  simulation  deserves  more  careful  examination  than  it  has 
received  to  date,  especially  in  view  of  the  large  procurements 
that  are  now  being  planned. 

F.  OVERVIEW 

In  summary,  the  effectiveness  of  flight  simulators  for  training 
pilots  has  been  demonstrated  beyond  doubt;  no  studies  were  found 
which  might  support  a contrary  finding.  This  conclusion  is  based 
largely  on  undergraduate  pilot  training  using  aircraft  and  simula- 
tors that  are  less  advanced  than  those  which  are  now  becoming 
available.  However,  the  conclusion  is  consistent  with  recent 
studies  on  modern  simulators  and  there  is  no  reason  to  believe 
that  it  will  be  altered.  Factors  that  influence  the  effectiveness 
of  simulators  have  received  little  systematic  attention.  It  is 
important  to  learn  more  about  the  rate  at  which  various  types  of 
training  occur  in  simulators,  i.e.,  the  shape  of  the  learning 
curves.  The  latter  information  is  needed  in  order  to  determine 
when  the  rate  of  learning  in  the  simulator  reaches  the  point  where 
it  becomes  more  economical  to  accomplish  additional  training  in 
the  aircraft.  There  is  also  a need  to  determine  the  degree  of 
fidelity  required  in  a simulator  for  various  types  of  military 
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training  as  well  as  the  effect  of  various  ways  of  using  the 
simulator  as  a ‘;raining  device.  The  fact  that  simulators  are 
effective  for  training  does  not  necessarily  imply  that  they  do  so 
economically  or  that  they  are  cost-effective  in  that  role. 


IV.  COST-EFFECTIVENESS  OF  FLIGHT  SIMULATORS 


There  is  no  lack  of  knowledge  concerning  how  to  conduct  a 
cost-effectiveness  analysis  of  training  (e.g.,  Duffy,  Miller  and 
Staley,  1977;  Doughty,  Stern,  and  Thompson,  1976;  Broby,  Henry, 
Parrish,  and  Swope,  1975;  Spangenberg,  Ribeck,  and  Moon,  1973; 

Swope,  1976;  Swope  and  Cordell,  1976;  Temkin,  Connally,  Marvin, 
Valdes,  and  Caviness,  1975;  Toomepuu,  1977;  Fisher,  1971). 

Volume  II  of  this  report  considers  in  great  detail  how  to  estimate 
the  costs  of  training  in  simulators  and  in  aircraft.  This  was 
necessary  because,  as  the  rest  of  this  chapter  demonstrates,  this 
knovjledge  has  not  been  applied  extensively  to  the  use  of  flight 
simulators . 

There  are  only  a few  studies  on  the  cost-effectiveness  of  a 
flight  simulator  in  actual  use  for  some  particular  type  of  training. 
However,  projections  of  cost-effectiveness,  based  on  arbitrary 
assumptions  of  flight  savings,  and  of  simulator  utilization  appear 
in  planning  studies  for  the  procurement  of  new  flight  simulators. 
Each  of  the  few  empirical  studies  found  is  described  briefly 
below,  with  particular  attention  given  to  the  form  of  the  cost- 
effectiveness  analysis. 

A.  Aircraft  Cockpit  Procedures  Training,  OV-1 

The  study  by  Prophet  and  Boyd  (1970),  noted  above,  approaches 
cost-effectiveness  by  comparing  the  effectiveness  of  three  devices, 
differing  widely  in  cost,  for  training  pilots  on  selected  ground 
cockpit  procedures  for  the  OV-1  aircraft.  The  three  devices  were: 

Aircraft,  OV-1 

Cockpit  procedures  trainer,  2-C-9 

Cockpit  mock-up,  constructed  of  plywood  and  photographs 
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The  2-C-9  trainer  is  a dynamic  simulator  with  a high  degree  of 
physical  fidelity.  The  locally  constructed  mock-up  provides  only 
rudimentary  representation  of  the  instruments  and  controls  in  the 
OV-1  cockpit.  The  subjects  (10  per  group,  rated  Army  aviators 
with  flight  experience)  were  trained  on  procedures  for  pre-start, 
start,  run-up,  and  shut-down  in  one  of  the  three  devices.  Actual 
flight  of  the  aircraft  was  not  involved.  After  tretining,  the 
ability  of  all  subjects  to  perform  17^  items  on  a checklist  was 
measured  in  the  airplane. 

The  main  result  was  that  all  devices  were  equally  effective 
for  teaching  OV-1  ground  procedures.  Cost  data  are  not  given, 
except  that  it  cost  about  $35  in  materials  and  20  man-days  of  labo” 
to  construct  the  mock-up;  presumably  the  mock-un,  the  2-C-9  trainer, 
and  the  aircraft  increase  in  cost,  in  that  order.  If  this  is  correct 
the  mock-up  would  be  the  most  cost-effective  device  for  teaching 
ground  procedures. 

This  study  need  not  be  regarded  as  a major  contribution  to 
the  litei-ature  on  the  cost-effectiveness  of  flight  simulators. 

It  does  not  consider  the  possibility  that  use  of  the  OV-1,  despite 
its  higher  initial  procurement  cost,  might  require  no  additional 
training  costs,  as  would  the  mock-up,  if  it  was  flown  so  little 
that  it  could  also  be  used  for  procedure  training  on  the  ground. 
Still,  it  bears  on  the  point  that,  depending  on  the  task,  it  may 
possible  to  demonstrate  that  a less  expensive  device  can  be  as 
effective  for  some  training  purposes  as  a more  expensive  one  with 
higher  apparent  fidelity.  Similar  findings  have  been  demonstrated 
by  Denenberg  (195^)  for  teaching  starting  and  stopping  procedures 
in  tanks,  and  by  Cox  et  al  (1965)  for  procedures  training  for 
the  Nike  Hercules  missile  system. 

B . Hours  Needed  to  Solo,  Piper  Cherokee 

In  this  study,  Povenmire  and  Roscoe  (1973)  were  directly 
concerned  with  determining  the  cost-effectiveness  of  the  Link  GAT-1 
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trainer  to  train  student  pilots  tc  solo  the  Piper  Cherokee,  a 
primary  flight  trainer  aircraft.  The  design  of  the  experiment 
was  to  determine  the  Incremental  Transfer  Effectiveness  Ratios 
for  groups  of  student  pilots  given  0,  3>  7,  or  11  hours  of  training 
in  the  simulator  concurrently  with  flight  instruction  in  the 
airplane . 

The  results,  in  Table  6,  show  that  instruction  in  the  simulator 
saved  some  flight  time  for  each  group,  but  additional  hours  after 
3 hours  in  the  simulator  produced  smaller  savings  in  flight  time. 
This  is  clearly  demonstrated  in  Figure  4.  The  operating  cost  of 
the  GAT-1  is  $16  per  hour  and  of  the  Piper  Cherokee  $22  per  hour, 
including  $8  for  the  instructor  in  each  case.  Therefore,  training 
in  the  simulator  is  cost-effective  until  the  Incremental  Transfer 
Effectiveness  Ratio  drops  below  the  ratio  of  simulator/aircraft 
operating  cost  per  hour.  The  latter  ratio  is  $16/22  = 0.73. 
Inspection  of  Figure  4 shows  that  for  this  study  that  point  occurs 
between  4 and  5 hours  in  the  GAT-1  for  training  student  pilots 
to  solo. 

This  excellently  conceived  study  should  serve  as  a model 
for  determining  the  most  cost-effective  use  of  flight  simulators 
for  training. 

TABLE  6.  HOURS  NEEDED  TO  PASS  FINAL  FLIGHT  CHECK 
FOR  STUDENT  PILOTS  GIVEN  0,  3,  7,  or  11 
HOURS  OF  INSTRUCTION  IN  THE  LINK  GAT-1 
TRAINER 


Hours  needed  Flight  time 


Group 

N 

to  solo  (avg) 

saved,  hrs 

CTER 

ITER 

Aircraft  only 

14 

45.4 

- 

- 

- 

Simulator 

3 hrs 

13 

40.3 

5.2 

1 .7 

1.7 

7 hrs 

9 

38.6 

6.8 

0.97 

0.41 

1 1 hrs 

10 

37.9 

7.5 

0.68 

0.17 

46 

C.  Cockpit  Motion,  Piper  Cherokee 

The  purpose  of  this  study  by  Jacobs  and  Roscce  (1975)  was  to 
determine  the  effect  of  cockpit  motion  in  a simulator  on  the  training 
of  student  pilots.  The  Link  GAT-2  simulator  provides  motion  in 
pitch  and  bank;  the  aircraft  was  the  Piper  Cherokee  Arrow.  The 
experiment  involved  training  student  pilots  (9  per  group)  under 
one  of  the  following  conditions: 

Airplane  only 

Normal  washout:  Simulator  with  normal  cockpit  motion 

(bank  motions  followed  by  below  threshold 
washout;  sustained  pitch  angles) 

Fixed  base:  No  simulator  motion 

Random  washout:  Normal  onset  and  acceleration  cues  in  bank 

but  direction  of  motion  reversed  randomly 
50  percent  of  the  time;  sub-threshold 
washout,  as  above;  normal  sustained  pitch 
angles. 

Performance  of  all  groups  was  measured  on  11  flight  maneuvers  in 
the  Private  .Pilot  Flight  Curriculum,  according  to  FAA  standards. 

The  experimental  results  are  shown  in  Table  7 and  a cost  analysis 
is  shown  in  Table  8. 

Training  in  the  simulator  saved  some  flight  time  for  each 
experimental  group.  Training  with  normal  banking  motion  and 
washout  saved  about  the  same  amount  of  flight  time  as  training 
without  motion.  Both  of  these  saved  more  time  than  training  with 
random  banking  motion  and  washout  but  even  the  latter  group  saved 
some  flight  time.  A striking  finding  is  that  no  subject  in  the 
latter  group  commented  on  the  strange  nature  of  the  randomly 
reversed  motion  during  training  or  when  questioned  specifically 
after  the  experiment.  Perception  of  motion  is  not  precise  and 
experience  with  uncoordinated  motion  forces  can  only  be  gained  in 
a I’light  or  similar  environment.  Thus,  it  may  be  that  a trainee, 
with  little  to  guide  him,  cannot  distinguish  between  random  or 
representative  motion. 
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TABLE  7, 


SUMMARY  OF  OVERALL  ^ 

MINUTES  AND  TRANSFER  EFFECTIVENESS  RATIO 
Ss  A FUNCTION  OF  SIMULATOR  COCKPIT  MOTION 
roNniTlONS 


Time  1n  Minutes 


' Plight 

GAT -2 
Time 

Experimental 

Group 

Flight 

Time 

Time 

Saved 

Airplane  Only 

387 

- 

- 

Normal  Washout 

248 

139 

442 

Fixed  Base 

255 

132 

442 

Random  Washout 

280 

107 

429 

Source:  Jacobs 

and  Roscoe, 

1975 

Transfer 
Effect! veness 
Ratio 


0.314 

0.299 

0.250 


TABLE  8. 


iNALYSIS  OF  COSTS  FOR  USE  OF  AIRPLANE 
,Nn  <;TMni  ATQRS  SHOWN  IN  TABLE  7 


Airplane 

Simulator 

Cost 

Savings 

Aircraft- 

Simulator 

Group 

Cost/ 

hr* 

Flight 

Time 

Saved, 

hrs 

Flight 

Costs 

Avoided 

Time 

Used, 

hrs 

Cost 

Airplane 

$28.00 

- 

- 

- 

— 

■ 

Normal 

Washout 

15.30 

2.32 

64.96 

7.37 

$112. 

76  -$47.80 

Fixed-Base 

10.60 

2.20 

61.60 

7.37 

78. 

12  - 16.52 

Random 

Washout 

15.30 

1 .78 

49.84 

7.15 

109. 

40  - 59.56 

* Including 

**  Control : 

instructor 

This  group 

used  the 

airpl ane 

6.45  hours  at  a 

t Negative  values  indicate  additional  cost  rather  than  savings 
Source:  Jacobs  and  Roscoe,  1975 
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The  cost  analysis  appears  to  indicate  that  the  airplane  is 
more  cost-effective  than  any  of  tne  simulator  conditions,  fixed 
or  moving,  in  this  experiment.  Among  the  simulator  conditions, 
the  fixed  base  version  is  most  cost-effective  (least  cost- 
ineffective).  Due  to  the  design  of  the  experiment,  the  amount  of 
time  spent  in  the  simulator  was  arbitrarily  fixed  and  some 
student-pilots  may  have  been  trained  on  the  simulator  beyond  the 
point  of  efficiency,  i.e.,  where  the  ratio  of  the  simulator/aircraft 
operating  cost  exceeded  the  ITER  of  the  simulator.  If  a criterion 
based  on  the  simulate r/aircraft  cost  ratio  had  been  followed,  use 
of  the  simulator  should  have  been  stopped  at  slightly  less  than 
1 hour  for  the  moving  base  group  and  at  slightly  less  than  2 
hours  for  fixed-base  simulator  group.  Up  to  these  points,  use  of 
the  simulator  for  triiir'r>'  have  been  more  cost-effective 

than  the  airplane. 
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D.  Helicopter  Training,  HH-52A  and  HH-3F 


This  study  by  Isley,  Corley,  and  Caro  (197^)  estimates  the 
cost  benefits  of  an  advanced  flight  simulator  and  an  improved 
syllabus  for  training  helicopter  pilots  in  the  Coast  Gua-’d  compared 
to  the  period  before  the  simulators  were  introduced.  Effectiveness 
is  estimated  by  the  number  of  simulator  and  flight  hours  needed 
to  qualify  pilots  in  the  new  program  compared  to  flight  hours 
alone  in  the  earlier  program.  No  experiment  was  performed.  Since 
an  improved  training  program,  based  on  specified  behavioral 
objectives  and  proficiency  based  advancement  was  Introduced 
together  with  the  simulator,  it  is  not  possible  to  determine  what 
portion  of  the  benefits  can  be  attributed  only  to  the  simulator. 

The  VCTS  (variable  cockpit  training  system)  can  simulate  both  the 
HH-52A  and  HH-3F  helicopters;  it  has  a motion  base  with  6 degrees 
of  freedom,  but  no  visual  system. 

Introduction  of  the  simulator  (and  the  improved  training 
program)  reduced  flight  hours  and  produced  the  savings  shown  in 
Table  9.  Operating  costs  of  the  simulator  are  much  less  than 
those  of  the  two  helicopters  ($59  per  hour  vs  $50^  and  $815). 
Proficiency  training  is  now  accomplished  solely  in  the  simulator. 

The  simulator  cost  $3100K  to  procure.  Realized  benefits  are 
estimated  at  $1454k  per  year,  plus  estimated  benefits  of  $1082K  per 
year  due  to  reduced  flight  time  in  preparation  for  check  rides. 

Thus,  depending  on  which  estimate  of  benefits  is  used,  the  Investment 
can  be  amortized  in  1.2  or  2.1  years.  The  required  level  of  flight 
proficiency  was  not  changed.  Savings  of  nearly  $1M  per  year 
for  197^-1976  are  noted  in  a more  recent  report  on  this  program. 
(Povenmire,  Russell,  and  Schmidt,  1977). 

E . Anti-Submarine  Warfare,  P-3C 

This  study,  by  Browning,  Ryan,  Scott,  and  Smode  (1977)  compares 
the  cost  and  effectiveness  of  two  programs  for  transition  training 
of  Naval  pilots  to  fly  the  P--3C,  a four-engine  turboprop  aircraft 
used  in  anti-submarine  warfare.  The  current  program  uses  the  2F87F 
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simulator,  an  experimental  syllabus  and  the  P-3C  aircraft;  the 
previous  program  used  the  2F69D  simulator,  a "standard"  syllabus 
and  the  P-3A/B  aircraft.  There  were  27  pilots  In  the  experimental 
and  16  In  the  control  group;  data  from  58  pilots  In  previous  classes 
were  used  as  another  control  group.  All  pilots  had  completed 
undergraduate  multi-engine  training  In  the  S-2,  a small,  two-engine 
propeller-driven  aircraft.  All  were  newly  designated  first-tour 
naval  aviators  and  possessed  Standard  Instrument  Cards.  After 
training,  performance  was  measured  In  the  aircraft  on  20  of  the 
45  tasks  In  the  Familiarization  and  Instrument  phase  of  transition 
training.  The  critical  data  were  the  flight  hours  required  by 
each  group  to  perform  these  tasks  In  a proficient  (l.e.,  acceptable) 
manner. 

The  following  devices  were  used  by  subjects  In  the  study: 

• Cockpit  Familiarization  Trainer  (CFT)  Device  2C23A. 

Provides  training  In  nomenclature,  location  and  function 
of  controls.  Instruments,  switches,  lights. 

• Cockpit  Procedures  Trainer  (CPT)  Device  2C45.  Provides 
training  In  powerplant  management  and  systems  procedures 
for  normal  and  emergency  operations  (actually  an  obsolete 
P-3  operational  flight  trainer  with  flight  dynamics,  motion, 
and  unneeded  systems  removed). 

• Operational  Flight  Trainer  (OFT)  Device  2F69D. 

Provides  crew  or  individual  training  for  pilot,  copilot,  and 
flight  engineer.  This  OFT  Is  a solid  state  analog  device 
(196f'  era)  which  simulates  flight  dynamics,  systems, 
navigation,  and  communications  for  P-3A/B  aircraft.  It 
provides  motion  with  3 degrees  of  freedom,  but  no  visual 
simulation. 
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• Operational  Flight  Trainer  (OFT)  Device  2P87F 

Recently  accepted,  this  is  a digital  device  which  simulates 
the  P-3C  Orion  aircraft.  It  provides  motion  with  6 degrees 
of  freedom  and  vision  (50*^  wide  x 38°  high)  by  means  of 
a TV  model  board  system  (15  nmi  x 5 nmi)  for  low-altitude 
maneuvers  such  as  takeoff,  landing,  and  instrument 
approaches.  It  replaces  the  2F69D. 

There  was  no  difference  between  the  experimental  and  control 
groups  concerning  their  flight  proficiency  as  measured  in  the 
aircraft  after  training  in  the  simulators,  as  described  above. 

The  basic  results,  in  terms  of  simulator  and  flight  hours  required 
to  achieve  this  proficiency,  and  the  related  cost  data,  are  shown 
in  Table  10.  Compared  to  the  earlier  program,  the  major  finding 
was  that  additional  hours  with  the  new  syllabus  in  the  new 
simulator  (24  vs  9)  can  reduce  the  hours  required  in  the  aircraft 
to  achieve  acceptable  performance  (9  vs  15).  Since  it  costs 
more  to  operate  the  aircraft  than  the  new  simulator  ($2284  vs  $144 
per  hour),  the  new  program  will  cost,  less  than  the  previous  one, 
even  though  it  offers  more  total  training  hours  per  student 
(49  vs  37).  The  crucial  aspects,  of  course,  are  the  Improved 
curriculum  and  the  increased  use  of  the  Improved  simulator  for 
training.  The  difference  in  operating  cost  per  hour  of  the  old 
and  new  simulators  is  trivial,  i.e.,  $10  per  hour. 

The  new  simulator  costs  $4.2  million  to  procure  while  the 
old  one  cost  $1.4  million.  Given  that  the  annual  operating  cost 
of  the  new  program  is  $2.5M  less  than  the  previous  one,  the  cost 
of  the  niw  simulator  would  be  amortized  in  less  than  2 years  (the 
estimate  does  not  Include  the  cost  of  developing  the  improved 
syllabus).  The  table  also  shows  that  fewer  aircraft  will  now  be 
needed  to  train  pilots  and  that  the  total  investment  cost  of  the 
new  program  is  $63  million,  compared  to  $99  million  for  the  previous 
one.  An  analysis  in  the  paper  shows  that  the  life-cycle  costs  of 
the  two  programs  over  a 10-year  period,  at  discounted  rates  in 
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accordance  with  DoD  Instruction  would  be  $8lM  for  the  new 

program  comnared  to  $125M  for  the  previous  one,  a savings  of  $i40M. 

In  this  analysis,  the  operating  cost  of  the  P-3C  is  given 
as  $2284  per  hour.  According  to  the  Navy  Aircraft  Program  Data 
Pile,  (January  1977)  the  operating  cost  of  the  P~3C  is  given  as 
$602  per  hour  (this  report.  Appendix  A).  If  the  latter  figure  is 
used  in  the  analysis,  the  savings  per  year  for  the  new  program 
would  be  $467K  instead  of  $248!)K  and  the  procurement  cost  of  the 
2P87P  simulator  would  be  amortized  in  9 rather  than  2 years.  We 
are  not  able,  at  the  time  of  writing  this  report,  to  explain  the 
reasons  for  the  wide  difference  between  the  two  values  for  the 
operating  cost  of  the  P-3C.  The  discrepancy  in  the  two  estimates 
strongly  points  to  the  need  for  reliable  data  for  use  in  analyses 
of  training  costs. 

'T’he  average  number  of  landings  needed  to  establish  proficiency 
in  the  experimental  group  was  36  per  pilot;  in  the  control  group 
it  was  92.  Presumably,  the  savings  in  flight  time  on  this  account 
could  be  related  to  the  cost  of  adding  a visual  system  to  the  new 
simulator  (lacking  in  the  old  one),  but  an  analysis  of  the  cost- 
effectiveness  of  this  feature  was  not  made.  Future  studies  on 
the  program  will  (1)  determine  substitution  ratios  through  comparison 
of  groups  trained  only  in  the  aircraft  w^th  those  trained  with  the 
simulator,  (2)  study  the  contribution  of  motion  to  simulator  training, 
(3)  and  evaluate  a strategy  based  on  training  pilots  to  established 
proficiency  standards  for  specified  tasks,  rather  than  on  allocating 
a pi'edetermined  number  of  hours  in  the  simulator  and  the  aircraft. 

The  latter  requires  developing  performa.ice  standards  and  using  a 
presently  unused  measuring  capability  of  the  2P87F. 

F . Airline  Use  of  Flight  Simulators 

The  airlines  are  often  cited  as  a model  for  the  use  of  flight 
simulators  to  train  and  check  flight  crews,  a procedure  wnicn 
has  been  approved  by  the  FAA.  The  procurement  of  simulators  by 
the  airlines  probably  influenced  the  Improvement  of  these  devices, 


especially  when  the  military  services  did  not  provide  a large 
market.  At  present,  some  airlines  operate  10  to  12  simulators. 

One  might  assume  that  the  airline  use  of  flight  simulators 
indicates  their  cost-effectiveness  for  training,  although  precise 
information  to  this  effect  has  not  been  published.  However,  it 
is  possible  to  construct  a general  estimate  based  on  information 
published  primarily  by  American  Airlines.  It  is  assumed  that  all 
airlines  follow  similar  procedures  because  they  must  comply  witr 
training  standards  set  by  the  FAA;  also,  they  cooperate  to 
establish  a training  program. 

Figure  5 shows  the  reduction  in  the  number  of  hours  in  the 
simulator  and  the  aircraft  for  transition  training  of  pilots  by 
American  Airlines  on  four  aircraft  over  the  period  1967-1975 
(Melden  and  Houston,  1975).  Transition  training  is  the  qualifica- 
tion of  a pilot  or  co-pilot  for  the  same  crew  position  on  another 
type  of  aircraft.  Using  transition  training  to  the  B-707  from 
1968  to  1975  as  an  example,  use  of  the  simulator  decreased  from 
27  to  19  hours,  while  use  of  the  aircraft  decreased  from  12.5  to 
about  j.5  hours.  For  '•he  DC-10,  which  was  Introduced  later, 
simulator  and  aircraft  time  declined  by  smaller  amounts  from  their 
Initial  levels  to  the  present  values  of  about  19  and  1.7  hours, 
respectively.  Table  11  shows  the  trend  towards  reduction  of 
simulator  and  aircraft  hours,  as  well  as  the  operating  cost  of 
these  devices.  Using  these  data,  and  information  published  by 
the  Civil  Aeronautics  Board,  the  cost  of  aircraft  and  simulator 
time  for  training  a captain  is  estimateo.  in  Table  12. 

These  results  can  be  regarded  as  suggestive  only,  since  the 
sources  •'n  which  they  are  based  did  not  necessarily  use  the  same 
assumptions.  Nevertheless,  they  do  suggest  that  the  costs  of 
training  a transitlonlrg  captain  are  now  about  30  to  80  percent 
of  their  earlier  values,  depending  on  which  airplane  is  used  for 
this  compariso-.i.  (The  median  value  is  about  percent.)  This 
finding  is  consistent  with  Figure  6 provided  by  American  Airlines 
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FIGURE  5. 


Average  hours  of  training  in  simulator  and 
airplane  for  Captains  in  transition  training, 
American  Airlines  (provided  by  Robert  C.  Houston, 
Director,  Training  Support,  American  Airlines) 


TABLE  11.  AVERAGE  TRAINING  HOURS  IN  SIMULATOR  AND 

AIRCRAFT  FOR  CAPTAIN  TRANSITION  PROGRAMS* 


Operating  cost/hr.  1975 
Ai rcraf t Simulator 


Aircraft 

Original 

Period 

Original 
Ai rcraf t 

Period,  hrs 
Simulator 

1974 

Aircraft 

hrs 

Simul 

B-747 

1970 

5.5 

28 

2.0 

19 

B-707 

1967 

12.5 

27 

1.3 

19 

B-727 

1967 

12.0 

28.5 

1.3 

19 

DC-10 

1971 

2.2 

23 

1 .7 

19 

♦Simulator  and  aircraft  hours  by  inspection  of  Figi-re  5; 
aircraft  cost  data  from  "Aircraft  Operating  Cost  and  Performance 
Report  for  Calendar  Years  1974  and  1975",  Civil  Aeronautics  Board 
July  1976;  simulator  cost  data  from  sev'  •!  private  source-.  Crew 
expenses  are  not  included 
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TABLE  12.  COST  ESTIMATE  OF  AIRPLANE-AND-SIMOLATOR 

TIME  FOR  CAPTAINS  IN  TRANSITION  TRAINING  IN 
1974  AND  AN  EARLIER  PERIOD 
(DATA  FROM  TABLE  11) 


Oriqii 

lal  Period 

1974 

1974  Costs  as 
Percentage  of 
Original  Cost 

B-747 

1970 

$20,669 

$9,941 

48 

B-707 

1967 

17,439 

5,263 

30 

B-727 

1967 

12,810 

3,616 

28 

DC-10 

1971 

6,975 

5,605 

80 

1966 


AIRCRAFT  SIMULATOR  AND 

AIRCRAFT  COMBINED 
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FIGURE  6.  Comparison  of  costs  at  American  Airlines  for 
transition  training  of  captains  for  the  B-727 
using  only  aircraft  (1966)  or  simulator  and 
aircraft  (1975);  1975  dollars  in  both  cases. 
Original  figure  does  not  contain  scale  for  dollars. 
(Source:  American  AirTfnes) 


which  ares  the  cost  of  transition  flight  training  for  the 
captain  of  a B-727  with  the  aircraft  alone  in  1966  or  v^ith  the 
simulator-and-aircraft  in  1975-  Both  estimates  are  based  on 
1975  dollars.  Note^  however,  that  no  dollar  scale  is  provided. 

Using  a ruler  to  measure  the  height  of  the  bars,  we  estimate  that 
training  with  simulator-and-aircraft  in  1975  cost  American  Airlines 
31  percent  of  what  it  cost  using  only  aircraft  in  1966. 

The  reduction  in  aircraft  time  shown  in  Figure  5 cannot  be 
attributed  primarily  to  the  introduction  of  flight  simulators, 
since  the  latter  were  in  use  throughout  the  period.  Presumably, 
the  reduction  in  aircraft  hours  must  be  related  in  some  way  to 
how  the  simulators  were  being  used.  Information  published  by 
American  Airlines  helps  explain  what  happened.  In  1966,  American 
Airlines  replaced  several  operating  bases  with  centralized 
training  at  one  location.  Standard  procedures  were  developed  and, 
for  the  first  time,  enforced  for  use  in  flight  and,  obviously,  in 
training.  Specific  performance  objectives  were  established  to 
define  the  skills  to  be  trained.  Training  in  these  skills  was 
sequenced  in  an  order  to  promote  efficient  learning.  Pilots  were 
trained  to  proficiency,  l.e.,  to  achieve  specified  performance 
standards  at  their  own  pace  rather  than  to  complete  their  training 
with  predetermined  time  limits.  Particular  lessons  in  the  curriculum 
were  assigned  to  the  classroom,  or  to  cockpit  procedure  trainers,  or 
to  individual  learning  by  means  of  audio-visual  cassettes  as  well 
as,  of  course,  to  the  simulator  and  the  aircraft.  Appropriate 
sequencing  of  these  lessons,  as  well  as  accomplishment  of  each  lesson 
by  the  least  expensive  but  acceptable  means  accounts,  in  general, 
for  reductions  both  in  simulator  and  in  aircraft  time.  Some  of 
the  Improvement  is  attributed  also  to  improved  handling  character- 
istics of  the  simulators  on  landing.  Since  the  simulators  did  not 
appear  to  perform  landing  maneuvers  in  a realistic  manner,  the 
airline  was  required  to  collect  flight  dynamics  data  not  previously 
available-.  Thus,  improvements  were  made  to  all  aspects  of  the 
training  program  and  not  only  to  the  flight  simulator  portion. 
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The  current  use  of  flight  simulators  by  American  Airlines 
appears  to  be  cost-effective.  Training  costs  were  reduced  to 
levels  that  appear  to  be  30-80  percent  of  what  they  were  before 
training  was  centralized  and  improved.  Simulators  were  given 
greater  emphasis  and  their  hours  of  use  declined  somewhat;  a 
greater  decrease  in  aircraft  hours  accounts  for  most  of  the  savings. 
Training  is  Judged  to  be  effective  according  to  the  criterion  that 
it  meets  PAA  standards,  as  did  the  previous  program.  American 
Airlines  claims  that  the  new  training  program  is  more  effective 
than  the  previous  one  because  the  safety  record  has  improved  and 
there  is  greater  crew  compliance  with  specified  operating  proce- 
dures. A major  lesson  from  this  experience  must  be  that  the  way 
in  which  the  flight  simulator  and  other  training  facilities  are 
used  is  at  least  as  important  as  whether  or  not  the  simulator 
is  used  at  all. 

One  airline,  which  will  not  be  identified,  provided  an  analysis 
concerning  the  cost-effectiveness  of  its  training  program  for  the 
year  1976.  The  data  in  Table  13  represents  the  use  of  simulators 
and  aircraft  for  all  training  purposes,  i.e.,  transition,  upgrading, 
and  periodic  requalification;  aircraft  types  are  not  named  so  as 
not  to  identify  the  airline.  The  analysis  is  based  on  the  assumption 
that,  if  a simulator  was  not  available,  each  simulator  training 
hour  would  have  been  performed  in  the  aircraft.  The  number  of 
days  needed  for  training  would  be  the  same,  regardless  of  whether 
training  was  accomplished  in  an  aircraft  or  in  a simulator  and, 
therefore,  with  no  Impact  on  travel  and  incidental  costs.  Fully 
allocated  costs  of  simulators  and  aircraft  are  used  in  the  analysis. 
The  analysis  is  conservative  because  it  does  not  include  the  cost 
of  delays  due  to  weather  or  to  the  scheduling  of  aircraft. 

The  use  of  simulator  and  aircraft  costs  this  airline  21  percent 
of  what  it  would  cost  if  only  aircraft  were  used  in  the  training 
program.  The  saving  is  estimated  to  be  $25  million  in  1 year 
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TABLE  13.  HOURS  SPENT  IN  TRAINING  IN  SIMULATORS  AND 

AIRCRAFT  AND  COST  COMPARISON  FOR  ONE  AIRLINE,  1976 


Aircraft 

Simul ator 
Hours 

Aircraft 

Hours 

Total  Hours 

\ 

A 

3,511.8 

185.7 

3,697.5 

t 

B 

8,996.8 

272.3 

9,269.1 

A 

C 

12,277.6 

547.2 

12,824.8 

1 

D 

1 ,262.1 

117.5 

1 ,379.6 

I 

1 

Total 

26,048.3 

1 ,122.7 

27,171 .0 

'i 

1 

i 

} 

i 

COST 

COMPARISON 

t 

1 

i 

1 

Aircraft 

Simulator  and  Aircraft 
Aircraft  Only 

Simulator  and 

Aircraft  as 

Percentage  of 

Ai rcraf t-Only 

Costs 

1 

\ 

j 

j 

j 

A 

$1 ,159,922 

$ 5,964,063 

19 

B 

2,093,150 

10,613,119 

20 

C 

2,909,287 

11  ,785,991 

25 

i 

D 

635,618 

3,654,560 

17 

.1 

1 

Total 

$6,797,977 

$32,017,738 

21 

y 

.1 


1 
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and  the  procurement  cost  of  the  simulators  ($17.5  million)  can  be 
amortized  In  less  than  9 months.  In  fact,  the  cost  of  the  entire 
training  facility  can  be  amortized  in  less  than  2 years. 

These  results  are  significant,  but  they  cannot  be  used  as  a 
standard  for  military  training.  The  airlines  are  concerned  only 
with  highly  experienced  pilots  who  are  permitted  to  fly  80  hours 
per  month  (the  current  average  is  about  50).  The  military  must 
train  undergraduate  pilots  and  maintain  the  combat  skills  of 
graduate  pilots  who,  on  the  average,  fly  100  to  200  hours  per  year. 

It  is  also  obvious  that,  except  for  transport  type  aircraft,  the 
airlines  and  the  military  services  perfoi’m  different  missions  and 
maneuvers  and  use  different  aircraft  and  simulators.  Although  flight 
simulation  offers  significant  advantages  to  the  airlines  and  to  the 
military  services,  direct  comparisons  of  the  costs  and  of  the  effec- 
tiveness of  simulators  for  these  users  should  not  be  made  without 
full  consideration  of  the  differences  in  the  two  applications. 

G . Current  Studies  of  Cost-Effectiveness  of  Flight  Simulators 

More  studies  on  the  cost-effectiveness  of  flight  simulators 
are  now  being  conducted  or  planned  than  were  completed  over  the 
last  10  to  20  years.  Only  current  studies  are  really  applicable 
to  the  new  simulators,  revised  syllabi,  and  the  modern  performance 
measurement  and  Instructional  strategies  that  are  replacing  our 
previous  concepts  of  flight  training.  The  following  efforts  are 
worthy  of  note. 

a.  Test  and  evaluation  of  the  Army’s  CH-47  Helicopter  flight 
simulator.  The  CH-47  Flight  Simulator  (2B31)  is  a new  device  which 
provides  motion  with  6 degrees  of  freedom  and  a visual  system 
based  on  a terrain  model  board  *1  ed  by  a TV  camt  ’’a.  Its  evalua- 
tion, at  the  US  Army  Aviation  Center,  Port  Rucke’.*,  includes  a 
combined  development  and  operational  test  (DT/OT  II)  conducted  by 
the  US  Army  Aviation  Board  and  a Cost  and  Training  Effectiveness 
Analysis  (CTEA)  conducted  by  the  Deputy  Chief  of  Staff  for  Combat 
Developments  Study  Group  of  the  Aviation  Center. 
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Transfer  of  traininp,  will  be  measured  for  control  (aircraft) 
and  experimental  (simulator)  pilots  in  the  CH-^7  Qualification 
Course  (called  "institutional  training").  Transfer  will  also  be 
measured  in  subsequent  unit  training  for  pilots  who  will  maintain 
their  skills  by  training  only  in  the  simulator,  or  only  li.  the 
CH~47,  or  with  a mix  of  the  two.  Using  data  developed  by  the 
tests,  cost  and  effectiveness  analyses  will  be  made  of  each  option 
available  for  pilot  training.  The  procurement  of  flight  simulators 
will  be  based  on  the  results  of  this  analysis.  The  time  frame  for 
this  study  is  January-October  1977.  (Toomepuu,  1977) 

Preliminary  data  on  the  first  four  pilots  to  complete  transition 
training  in  this  program  are  summarized  in  Table  14.  The  initial 
findings  are  that  the  experimental  pilots  can  accomplish  their  check 
ride  after  17  hours  in  the  simulator  and  17  hours  in  the  helicopter 
compared  to  a control  group  that  i*equired  27  hours  when  trained 
solely  in  the  helicopter.  The  experimental  group  received  a higher 
average  grade  than  the  control  group  on  the  check  flight  (86  compared 
to  81)  and  the  cost  of  transition  training  was  reduced  by  $8412 
per  pilot.- 

TABLE  14.  AVERAGE  TIME  REQUIRED  TO  ACCOMPLISH  CHECK  RIDE 
FOR  TWO  GROUPS  OF  PILOTS:  PRELIMINARY  DATA 


Hours  Required 

Average  Score  for  Check  Ride,  Cost/ 


Group 

N 

on  Check  Ride 

Simulator 

Aircraft 

Pi  1 ot* 

Control 

- 

81 

- 

27 

$27,027 

Experi - 

mental 

4 

86 

17 

17 

18,615 

Savings  per  pilot  $8,412 


♦Based  on  operating  cost  per  hour  of  $1001  for  the  CH-47 
helicopter  and  $94  for  the  2B31  flight  simulator. 

Source:  Aviation  Systems  Division  - Army  DCS/RDA, 
Weekly  Summary,  4-8  April  1977 


b . Simulator  Training  Requirements  Effectiveness  Study  (STRES) 

The  purpose  of  this  program  is  to  determine  the  cost  and 
effectiveness  of  major  features  of  flight  simulators  for  use  in 
training.  The  method  is  to  collect  and  evaluate  historical  data, 
including  some  from  current  training  programs  of  the  three  services 
and  the  airlines.  Attention  will  be  given  to  determining  the 
degree  of  fidelity  necessary  to  achieve  specific  training  objectives, 
the  most  effective  ways  of  using  flight  simulators,  and  the  most 
effective  types  of  instructional  features  for  such  devices.  An 
effort  will  also  be  made  to  identify  the  factors  that  influence 
the  costs  of  ownership  of  flight  simulators.  The  first  phase  of 
this  study,  which  was  to  develop  a methodology  and  plan  of  work, 
has  been  completed.  It  appears  that  the  worth  of  simulators  should 
be  assessed  not  only  in  savings  attributed  to  reduced  flying  hours 
but,  if  possible,  in  savings  attributed  to  their  influence  on  safety 
and  accident  rates,  life-cycle  costs,  acquisition  dollars  in  rela- 
tion to  flying  hour  avoidance  and  extended  useful  lifetimes  for  the 
aircraft.  The  study,  which  is  being  conducted  by  the  Air  Force 
K-man  Resources  Laboratory,  Advanced  Systems  Division,  with  the 
assistance  of  a tri-service  management  team,  is  scheduled  for 
completion  by  December  1978.  (AFHRL-ASD  Project  No.  1710-03-42, 

PE  62205  F,  25  Aug.  1976). 

c . Other  Studies 

Other  known  studies  are  cited  by  title  alone  (the  list  may 
not  be  complete): 

Cost  Analysis  of  Visual  Motion  Systems  of  ASPT. 

APHRL-FTD  1123-03-31 

Development  of  Life  Cycle  Cost  Analysis  Methods. 

APHRL-FTD  1123-02-66 

Cost  Effectiveness  Methodology  for  Aircrew  Training  Devices. 

APHRL-FTD  1192-05-03 

Development  of  USAF  Military  Personnel  Costing  Techniques 

for  Use  in  Weapon  System  Design. 

AFHRL-ASD  1124-03-06 
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Life  Cycle  Cost  of  Simulated  vs  Actual  Avionic  Maintenance 

Equipment  for  the  F-l6  Training  Program. 

AFHRL-ASD  1710-03-0*1 

Simulator  Capabilities  Assessment  Study. 

AFSC-ASD-SD-2*!  Simulator  System  Program  Office 

H.  Discussion 

Only  two  studies  were  found  which  relate  directly  to  the  cost- 
effectiveness  of  modern  flight  simulators  for  use  by  the  military 
in  flight  training.  Browning,  Ryan,  Scott,  and  Smode  (1977)  report 
that  the  cost  of  the  2P87F,  a new  simulator,  can  be  amortized  in 
less  than  2 years.  The  2P87F  is  being  used  for  transition 
training  of  about  200  Naval  pilots  a year  to  fly  the  P-3C,  an 
aircraft  used  in  anti-submarine  warfare.  Isley,  Corley,  and  Caro 
(197**)  show  that  the  cost  of  the  VCTS,  another  new  simulator,  can 
be  amortized  in  2 years  or  less.  The  VCTS  is  being  used  for 
transition  and  proficiency  training  of  about  500  Coast  Guard  pilots 
a year  to  fly  the  HH-52A  and  HH-3F  helicopters  used  in  air/sea 
rescue.  Of  course,  the  Coast  Guard  is  not  a military  service,  but 
its  training  and  proficiency  program  may  be  regarded  as  similar, 
in  selected  areas,  to  that  of  the  military  services. 

These  amortization  periods,  based  on  actual  training  programs, 
are  less  than  an  estimate  of  **.8  years  provided  by  the  DoD  to  the 
Congress  (DoD  Report  on  Flight  Simulation  to  the  Senate  Armed 
Services  Committee,  February  1977)  This  is  the  median  value  of 
the  amortization  periods  for  97  units  of  2*1  different  flight 
simulators  authorized  or  requested  during  FY  1976-FY  1978.  The 
value  of  4.8  years  assumes  a 6 percent  discount  rate  over  the  pay- 
back period;  it  would  be  3*8  years  if  no  discount  is  assumed. 

Although  the  information  and  analyses  available  to  us  are 
quite  limited,  it  appears  that  an  airline  might  be  able  to  amortize 
its  investment  in  flight  simulators  for  transition  and  proficiency 
training  on  commercial  aircraft  within  one  year. 

Povenmlre  and  Roscoe  (1973)  and  Jacobs  and  Roscoe  (1975)  show 
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that  the  cost-effectiveness  of  a flight  simulator  for  training 
purposes  is  greater  during  the  earlier  rather  than  during  the  later 
stages  of  training  on  the  tasks  that  were  studied.  This  is  simply 
the  result  that  the  rate  of  learning  on  the  simulator  decrn^ses 
with  additional  practice,  i.e.,  the  learning  curve.  The  cross-over 
point  for  cost-effectiveness  of  the  simulator  occurs  when  the 
incremental  transfer  effectiveness  ratio  (ITER,  the  amount  of 
additional  learning  per  unit  time  in  the  simulator)  becomes  less 
than  the  simulator/aircraft  operating  cost  ratio.  Although  these 
two  reports  by  Roscoe  and  his  co-authors  are  based  only  on  student 
pilots  using  simple  simulators  while  learning  to  fly  private 
aircraft  (Piper  Cherokee),  there  is  no  reason  to  anticipate  different 
results  with  the  more  complex  simulators  and  airci-aft  used  by 
the  military  services. 

The  finding  that  flight  simulators  are  cost-effective  for  the 
P-3C,  HH-52A  and  HH-3P,  and  the  airlines,  is  based  on  analyses  of 
entire  tralnin'^S  programs  or,  at  least,  on  large  segments  of 
training  programs.  General  knowledge  about  learning  curves,  as 
well  as  the  findings  in  the  two  studies  which  report  ITER*s, 
suggest  that  the  cost-effectiveness  of  flight  simulators  could  be 
optimized  within  training  programs,  provided  Information  was  avail- 
able on  rates  of  learning  various  tasks  in  the  flight  training 
syllabus.  This  Information  is  needed  to  determine  when  additional 
training  is  better  given,  on  cost-effectiveness  grounds,  in  the 
aircraft  rather  than  in  the  simulator.  Such  information  is  not 
currently  available.  Its  collection  on  a systematic  basis  is 
desirable  and  probably  necessary,  in  the  long  run,  to  control 
training  costs,  although  it  is  not  suggested  that  it  would  be  a 
trivial  undertaking  to  collect  the  necessary  data. 
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V.  IMPROVEMENT  OF  FLIGHT  SIMULATORS 


A modern  flight  simulator  can  Include  many  subsystems,  such 
as  the  basic  cockpit  and  data-processing  equipment  required  to 
represent  a wide  range  of  flight  conditions,  a motion  platform, 
a visual  display  which  represents  the  outside  world,  and  a instruc- 
tor's console,  with  some  performance  measurement  and  flight 
demonstration  capabilities.  At  present,  major  research  and 
development  activities  for  the  improvement  of  flight  simulators 
center  on  the  motion  and  visual  subsystems. 

Almost  all  flight  simulators  procured  recently  or  planned  for 
procurement  by  the  DoD  have  motion  and  visual  systems.  Visual 
systems  will  be  retrofitted  into  some  simulatoi’s  which  now  lack 
them.  In  a recent  survey,  16  domestic  airlines  reported  that  they 
own  70  simulators,  only  two  of  which  lack  motion;  all  have  visual 
systems.  (Killian  1977).  Many  foreign  airlines  not  included  in 
the  survey  are  also  known  to  operate  simulators  with  visual  and 
motion  systems. 

Early  simulators  provided  platform  motion,  but  it  was  of  such 
poor  quality  that  it  was  abandoned.  Many  flight  simulators  built 
10  or  more  years  ago  did  not  have  motion  and  visual  systems  and 
were  used  primarily  for  training  in  instrument  flight  procedures, 
navigation,  and  radar.  Improved  motion  and  visual  systems  tended 
to  make  flight  simulators  more  acceptable  to  pilots,  particularly 
in  the  case  of  the  airlines.  Simulators  with  motion  and  visual 
systems  are  intended  for  use  in  training  on  such  tasks  as  takeoff 
and  landing,  air-combat  maneuvering,  air-to-ground  attack,  carrier 
landing,  formation  flying,  aerial  refuelling,  and  nap-of-the-earth 
flight  in  helicopters. 
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Typical  current  costs  for  the  major  components  of  flight  I 

simulators  are  shown  in  Table  15.  It  will  be  seen  that  a basic  3 

flight  simulator,  including  the  data  processing  needed  to  drive  | 

! 

the  instruments  and  dynamic  controls,  costs  about  $2M.  Platform  i 

motion  adds  $0.2M  to  $0.5M  to  this  cost;  the  motion  system  for  a 
fighter  is'  more  expensive  than  one  for  a wide-bodied  aircraft, 
since  it  needs  a larger  and  heavier  visual  system  and  maneuvers 
more  violently.  Additional  military  construction  needed  to  ; 

accommodate  a motion  base  is  estimated  to  cost  $30K;  operation  and 
maintenance  is  estimated  at  $30-35K  per  year.  The  10-year  life-  I 

I 

cycle  cost  of  a motion  base  is  estimated  to  add  $530K-$580K  to 
the  total  cost  of  a wide-bodied  aircraft  flight  simulator  and  , I 

$830K-$880K  to  that  of  a fighter  (Cost  Analysis,  1976).  Visual  I 

[systems  might  add  from  $0.3M  to  $4.5M  to  the  basic  cost,  depending  j 

on  the  complexity  of  the  display;  the  cost  will  be  larger  if  the  j 

simulator  requires  two  cockpits;  life-cycle  cost  data  were  not  I 

I 

I available  for  visual  systems.  ^ 

I ^ 

I A.  Motion  Systems  i 

[:  3 

> ^ 

r The  need  for  motion  in  flight  simulators  has  been  qu^-tloned  1 

seriously  on  the  basis  of  a recent  researc’  '’i-dlng.  Th  it  of  j 

simulators  has  also  been  questioned.  The  rebearch  finding  is  that  1 

I 

pilots  perform  equally  well  in  aircraft  whether  trained  in  Simula-  ^ 

tors  with  or  without  platform  motion.  Major  Jefferson  M.  Koonce, 

USAP  (1974)  working  with  Stanley  N.  Roscoe  at  the  University  of 
Illinois  at  Urbana-Champalgn,  studied  the  effect  of  transfer  of  i 

refresher  training  in  Instrument  skills  from  a Link  GAT-2  Simula-  i 

tor  to  a Piper  Aztec  airplane.  All  subjects  (10  per  group)  were  ? 

Instrument  pilots  trained  Identically  in  the  simulator  in  one  of 
- three  ways:  < 

; • No  motion  I 

• Sustained  banking  and  pitching  motion  j 

• Subliminal  ’ 'hout  of  banked  attitudes  during  turns.  s 

1 

The  GAT-2  provides  iii<ji,j.on  with  2 de/grees  of  freedom:  bank  and 
pitch.  Banking  in  order  to  turn  an  aircraft  produces  a rotational 


60 


TABLE  15.  TYPICAL  PROCUREMENT  COSTS  FOR  MAJOR  COMPONENTS 

OF  CURRENT  FLIGHT  SIMULATORS.  SOURCE:  SIMULATOR 
SYSTEMS  PROGRAM  OFFICE,  ASD  AFSC,  MARCH  1977 


Examples* 

Cockpit  $2  M F-5 

Functional  Systems 
Dynamic  Control  Loading 
Flight  and  Navigation  Instrumentation 
Some  Weapons  Functions 

Notion  Cueing 


Fighter  6 DOF 

0.5 

Wide  body  6 OOF 

0.2 

6-su1t,  G-seat,  Buffet 

0.2 

Visual  Systems 

Dome  Systems 

3.3 

two  domes  0.3 

sky-earth  projectors  0.4 

missile  projectors 
eight  target  projectors  0.3 

target  generation  2.3 

Dual  dome.  Computer  Image  Generator 

3.3 

Alr-to-Ground, 

F-15 

Ouoview  (1  window,  1 channel) 

1.4 

KC-135 

Night  only,  CGI  (1  window,  1 channel) 

0.3 

EF-111A 

Night  only,  CGI  (3  windows,  3 channels) 

0.4 

EF-lllA 

Day-night  Image  Generation  (3  windows,  3 

channels)  1.3 

EF-lllA 

Dual  Fighter/Attack 

4.5 

Air-to-Surface 
Alr-to-Gi^ound 
ASPT,  F-16 

Double  ASPT  CGI 

6.2 

Terrain  Model  Board 

1.8 

UPT-IFS** 

Night-only  CGI 

1.8 

UPT-IFS** 

Day  and  Night  CGI  . 

3.3 

UPT-IFS** 

Sensors 

Alr-to-AIr  Radar 

0.4 

Digital  Radar  Landmass 

2.8 

EF-lllA 

Instructional  Features 

Engagement  Display 

0.3 

Automated  Demonstrations 

0.1 

Automated  Flight  Training  System 

0.3 

Logicon 

*Few  of  these  systems  have  yet  been  procured 

**Cost  estimates.  Including  acquisition.  Installation  and  spare 
parts  for  procuring  ten  visual  systems  over  period  1979-1981. 
Nemo  UPT-IFS  Visual  Systems,  AFSC,  7 March  1977. 
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cue  (bank):  tae  pilot  feels  a centrifugal  force,  head  to  seat,  in 
the  vertical  plane  of  the  aircraft.  A simulator  can  accu- 
rately provide  the  initial  rotary  cue.  However,  because  the 
simulator  is  fixed  to  the  ground,  sustained  bank  angle  produces 
an  erroneous  cue;  the  pilot's  tilted  body  is  pulled  to  the  ground 
rather  than  directly  to  the  seat.  "Washout"  is  the  technique 
which  reduces  this  erroneous  cue.  After  the  turn  is  initiated, 
the  bank  angle  is  restored  to  normal  at  a rate  below  the  pilot’s 
threshold  of  awareness;  at  the  completion  of  the  turn,  the  platform 
is  rotated  in  the  opposite  direction,  followed  again  by  washout. 

Koonce  found  that  all  groups  trained  in  the  simulator  performed 
better  in  the  aircraft,  i.e.,  positive  transfer  of  training  as 
shown  by  fewer  errors  in  the  aircraft.  However,  the  group  trained 
without  motion  showed  about  the  same  performance  in  the  air  as 
did  those  trained  with  motion.  This  was  the  first  study,  as  far 
as  is  known,  to  demonstrate  that  motion  in  flight  simulators  does 
not  contribute  more  than  no  motion  does  in  training  pilots  to  fly 
aircraft.  Many  previous  studies  had  shown,  with  some  exceptions, 
that  motion  improved  a pilot’s  ability  to  fly  a simulator.  (Puig 
1970;  Sundry  1976  a,  b;  Mathany,  Lowes,  and  Bynum  197^;  Huddleston 
1966;  Klier  and  Gage  1970;  Muckier  et  al  1959;  Borlace  1967; 

Brown,  Johnson,  and  Magnall  i960).  But  the  effect  of  simulator 
motion  on  aircraft  performance  had  not  been  explored.  In  fact, 
Koonce ’s  study  was  concerned  not  directly  with  motion  but  with 
determining  the  value  o^  ground-based  simulator  performance  measures 
for  predicting  pilot  proficiency  in  aircraft. 

Jacobs  and  Roscoe  (1975)  confirmed  this  finding  in  a further 
study  which  was  described  in  Chapter  V.  Subjects  trained  in  the 
Link  GAT-2  with  motion,  including  randomly  reversed  motion,  showed 
no  reliably  greater  transfer  to  the  airplane  than  did  those  with 
no  motion. 

Starting  in  197^,  the  Air  Force  undertook  a series 
of  studies  to  determine  whether  flight  simulators  used  for  training 
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need  motion  systems  and  reviewed  plans  to  procure  simulators  which 
would  include  them.  .\s  of  this  writing  (May  1977) » some  F-l6 
night  simulators  will  be  procured  without  motion  systems. 

However,  it  will  be  possible  to  add  motion  systems  at  a later  time 
if  it  can  be  shown  that  they  are  cost-effective  for  training. 

A summary  of  current  studies  is  shown  in  Table  16;  some  of  the 
findings  are  based  on  briefings  and  informax  discussions  and  are 
obviously  subject  to  change;  results  of  some  of  the  studies  were 
not  available  at  the  time  of  writi'^g. 

In  every  case,  students  trained  in  a simulator  without  motion 
performed  as  well  in  the  air  as  students  trained  with  motion.  The 
presence  of  motion  in  the  simulator  does  not  seem  to  make  a sig- 
nificantly obser/ablti  contribution  to  flight  performance.  This 
applies  to  undergraduate  and  to  graduate  military  pilots  and,  in 
Roscoe's  studies,  to  qualified  ■'nstrument  pilots  and  to  college 
students  with  no  previous  flight  experience.  It  applies  to  the 
ASPT,  T-4G,  and  Link  GAT-2  simulators  which  have,  respectively, 
moticii  systems  with  6,  3,  and  2 degrees-of-freedom.  It 
applies  to  gentle  maneuvers  (take-off,  straight-in,  overhead 
traffic  patterns)  and  to  advanced  undergraduate  acrobatics 
(Immelman,  Cuban  8,  clever  leaf,  barrel  roll).  KC-135  pilots 
trained  with  motion  were  better  able  to  handle  outboard  engine 
failure  on  takeoff  than  those  trained  without  motion;  this  finding 
applies  only  to  training  in  tre  simulator  and  was  not  tested  in 
flight. 

It  has  generally  been  accepted  that  fidelity  of  simulation  is 
important  for  training  purposes.  To  meet  this  need,  motion  systems 
have  been  improved  with  respect  zo  mechanization,  driving  algorithms, 
resp'^nse  rates,  and  degrees-of-freedom.  Nevertneless,  motion  in 
improved  simulators  does  not  contribute  significantly  to  effective- 
ness of  training,  and  it  is  difficult  to  believe  that  the  findings 
can  be  modified  substantially  by  additional  studies. 
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TABLE  16.  SUMMARY  OF  RECENT  EXPERIMENTS  SHOWING 
EFFECT  OF  SIMULATOR  MOTION  ON  TRAININ 
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Nevertheless,  It  is  important  to  observe  strict  qualifications 
to  the  findings  based  on  the  use  of  ASUP?  in  these  studies.  ASUPT, 
the  Air  rui.e's  Advanced  Simulator  for  Undergraduate  Pilot  Training 
at  Williams  Air  Force  Base,  is  a unique  flight  simulator.  (It  is 
now  called  ASPT,  Advanced  Simulator  for  Pilot  Training.)  Its  use 
and  the  undergraduate  pilots  who  served  as  subjects  in  these 
expeT'iments  may  have  influenced  the  current  results  in  the  following 


ways : 


Wide-angle  visual  system 


The  visual  system  in  ASUPT  provides  a wide  angle, 
computer- generated  image  of  the  excernal  visual  world  that 
is  240°  horizontal  and  160°  vertical  in  size.  This  visual 
system,  which  was  used  in  all  experiments  on  ASUPT,  creates 
ari  overwhelming  impression  of  physical  motion  in  the  observer, 
even  when  the  platform  does  not  move.  It  can  be  noted  in 
Table  l6  that  a reduced  field  of  view  led  to  some  degrada- 
tions in  flight  performance  jn  the  simulator;  the  effect  of 
smaller  fields-of-view  in  the  simulator  on  performance  in 
the  aircraft  will  be  determined  in  future  studies. 

2.  T-37  Simulation 

The  ASUPT  was  configured  to  represent  the  T-37j  a center- 
thrust,  training  aircraft.  Engine-cut  procedures  were  not 
tested  in  these  experiments.  Nevertheless,  platform  motion 
(i.e.,  yaw)  might  provide  significant  cues  for  training 
pilots  in  detecting  asymmetrical  thrust  due  to  engine  failure 
during  takeoff  in  large  multi-engine  aircraft  such  as  the 
KC-I35.  (DeEerg,  KcFarland,  and  Showalter,  1976) 

3.  The  motion  system  in  ASUPT 

It  is  known  that  the  motion  system  in  ASUPT  lags  the 
visual  system  by  about  100  ms.  This  is  due  to  the  fact  that 
the  update  rate  is  7-5  Hz  for  the  motion  system  and  30  Hz  for 
the  visual  system  (Larsen  and  Terry,  1975).  The  ASUPT  mouion 
system  will  be  improved  so  that  its  update  rate  is  equal  to 
that  of  the  visual  system. 

. Undergraduate  pilots 

The  subjects  in  the  ASUPT  studies  were  undergraduate 
pilots  and  were  flight-naive  in  the  Jacobs  and  Roscoe  (1975) 
study.  Different  results  may  be  found  with  experienced 
pilots  who  would  be  more  knowledgeable  about  motion  cues  in 
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the  simulator.  Ellis,  Lowes  et  al  (1967);  Matheny,  Lowes, 
and  Bynum  (197^);  and  Bergeron  (1970)  have  shown  that 
experienced  pilots  maintain  about  the  same  level  of  quality 
of  performance  in  the  simulator  even  when  Jhe  fidelity  of 
the  motion  simulation  is  varied  for  purposes  of  the  experiment. 
However,  the  recent  experiments  did  not  examine  uhe  effect 
of  such  variations  in  simulator  motion  quality  on  performance 
in  the  aircraft.  Further,  the  findings  on  the  effect  of 
motion  fidelity  on  performance  in  the  simulator  may  also  be 
specific  to  the  particular  aircraft,  maneuvers,  and  simulators 
used  in  these  studies. 

Thus,  the  finding  that  simulator  motion  does  not  contribute 
so  aircraft  performance  has  been  demonstrated  with  some,  but  not 
with  overwhelming  generality:  undergraduate  pilots  (with  tests 
underway  for  more  experienced  pilots;  simulators  with  a wide 
field-of-view  (ASUPT)  and  no  external  visual  display  (GAT-2  in 
the  Koonce  and  Jacobs  studies);  and  center-thrust  (ASUPT  and  T-37) 
and  two-engine  aircraft  (GAT-2  and  Piper  Aztec),  and  on  a simulator 
with  a phase  lag  between  the  visual  and  motion  systems  (i.e., 

ASUPT).  Additional  studies  are  clearly  needed,  and  some  which  are 
already  scheduled  are  noted  in  Table  16.  Issues  which  must  be 
addressed  Include  the  quality  of  the  motion  simulation  (in  such 
critical  aspects  as  the  transfer  functions,  servo  response, 
washout),  ancillary  cues  (g-seat,  g-suit,  dynamic  harness,  and 
helmet  straps),  visual  field  of  view  (size  and  content  of  the 
Imagery),  compatibility  between  all  cues  provided  in  the  simulator 
(partlcula •’ly  motion  and  vision),  other  types  of  aircraft  (particu- 
larly motion  and  vision),  other  types  of  aircraft  (particularly 
wide-bodied  types),  other  military  tasks  and  levels  of  pilot 
experience . 

Although  the  findings  appear  to  Indicate  that  motion  does  not 
contribute  significantly  to  training  (under  the  conditions  identi- 
fied above),  it  would  be  a mistake  to  conclude  that  motion  is  not 
needed  in  all  simulators  or  for  all  purposes  for  which  flight 
simulators  are  or  might  be  used.  First  of  all,  motion  systems 
differ  significantly  in  their  response  characteristics  and  degrees 
of  freedom.  This  is  shown  clearly  in  Table  17,  taken  from  Johnson, 
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SYSTEM 


RESPONSE 


SINGER 
(3  OOP)* 


SINGER 
FBtll 
IS  OOF) 


SINGER 
MINCH 
LEGS 
(6  OOF) 


SINGER 
60  INCH 

LEGS  I AMES 
(6  OOF)  FSAA 


NORTHROP 
AMES  LAMAR 
(6  DOF)  (5  OOF) 


ATKINS  & ATKINS  , 

MERRIL  MERRIL  { REDIFOI 
14  OOF)  16  OOF)  I leOOPt 


PITCH 

ROTATION  Idtg) 
VELOCITY  ld«9^s) 
ACCELERATION  ld«9/s^) 
FREQUENCY  IHz)“ 


ROLL 

ROTATION  Idag) 
VELOCITY  |d«g/i) 
ACCELERATION  Idag/s^) 
FREQUENCY  iHt)** 


YAW 

ROTATION  Idag) 
VELOCITY  Idag/s) 
ACCELERATION  ld«g/f^) 
FREQUENCY  IHr)** 


VERTICAL 

TRANSLATION  |ft) 
VELOCITY  Ifl/*) 
ACCELERATION  !G) 
FREQUENCY  IHi)** 


LATERAL 

TRANSLATION  |(t) 
VELOCITY  ift/i) 
ACCELERATION  IG) 
FREQUENCY  IHii” 


LONGITUDINAL 
TRANSLATION  Ift) 
VELOCJTY  lft/$) 
ACCELERATION  <G) 
FREQUENCY  iHi)** 


PAYLOAD 
WEIGHT  (lb) 
Ixx  ISLUG/ft^) 
lyy  iSLUG/ft*) 
Ui  ISLUG/ft') 


DOFo  OEGREE-OF  FREEDOM 

'’frequency  at  30®  PHASE  LAG 

• «« 

ESTIMATED  VALUE 

^PAYLOAD  CAN  BE  INCREASED  TO  18  000  lbs 
COMBINED  WITH  LATERAL  RADIUS  OF  40  ft 


♦26.  -24 
IS 


♦30. -26 
15 
SO 


+16.  -10 
10 

7100 

0.7 


♦30, -20 
22 
90 
1 


122 

IS 

SO 

I-.. 

ae 

29 

92 

3.1 

132 

+24 

IS 

29 

SO 

92 

r- 

1.7 

+3.2.-2.5 

14 

2 

6.9 

0.8 

0.31 

l”* 

2.2 

14 

140 

2 

16 

0.6 

0.31 

r” 

1 

+4.1.-4 

+3 

2 

5 

0.6 

0.25 

r" 

1.8 

10,000 

10.000 

'.o,000 

18,000 

— 

- 

33,000 

33,000 

- 

- 

37,000 

37,000 

1 

— j 

19,000  { 

1 

19,000 

TABLE  17 


. Typical  Motion  System 
Specifications.  (Source 
Johnson,  Knight  and 
Sugarman,  1975) 


t — 

B & 

» 

ATKINS 
MERRIL 
(6  OOF) 

REOIFON 
(6  OOF! 

REFLE;:- 

TONE 

60  INCH 
(6  OOF) 

McOONNELL 
OOUGLAS 
(T  OOF) 

McOONNELL 
OOUGLAS 
« OOF) 

McOONNELL 
OOUGLAS 
(6  OOF) 

CAE 

ELECTRONICS 
(4  OOF) 

CAE 

ELECTRONICS 
16  OOF) 

CAE 

ELECTRONICS 
(6  OOF) 

B 

♦30, -20 

♦28 

♦30, -25 

+15,-6 

♦14,  -9 

♦15 

♦20,-12 

132 

+32,  -28 

: 

22 

17 

20.3 

IS 

20 

15 

10 

20 

20 

: 

90 

80 

200 

- 

25 

50 

100 

60 

1 

1 

0.7 

- 

- 

- 

- 

— 

— 

1 

f 

♦24 

♦19 

±27 

±10 

115 

120 

rio 

+28 

+25 

f 

22 

12 

22.9 

20 

.. 

20 

18 

20 

20 

90 

80 

200 

- 

5 

- 

30 

100 

60 

0.7 

- 

- 

- 

- 

— 

— 

— 

S’ 

NOI.E 

NONE 

NO  inoepenoent'^^ 

♦35 

19 

♦33 

♦10 

♦34 

♦32 

1 

22 

11 

23.8 

10 

20 

22 

90 

80 

200 

- 

100 

60 

1 

0.7 
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Knight,  and  Sugarman  (1975)  • Note  particularly  the  wide  variations 
In  acceleration  and  frequency.  Other  than  noting  the  degrees  of 
freedom  of  the  simulator  being  used,  very  few  studies  report  the 
dynamic  response  characteristic  of  the  simulator  being  used. 

This  Information  Is  needed  In  order  to  Interpret  and  compare  the 
results  observed  with  various  simulators.  Further,  for  purpose 
of  experimentation.  It  will  also  be  Important  to  be  able  to  vary 
acceleration  and  frequency  or,  at  least,  to  replicate  experiments 
on  simulators  with  different  response  characteristics. 

Secondly,  simulator  motion  may  be  needed  for  some  types  of 
training.  Examples  which  come  to  mind  Include  training  for  Instru- 
ment flight  where  the  pilot  must  be  made  aware  of  the  fact  that 
certain  motion  cues  may  mislead  him  and  that  Instrument  data  are 
more  reliable  than  what  he  may  learn  from  the  seat  of  his  pants. 

A good  list  of  Instrument  flight 'situations  that  may  lead  to 
Incorrect  Judgments  by  the  pilot  may  be  found  in  Puig  (1970, 
modified  from  a paper  by  Vinake,  19^7).  For  example,  a level  turn 
may  be  interpreted  as  straight  flight  because  the  rate  of  change 
in  turn  is  too  small  to  stimulate  the  semicircular  canals;  straight 
and  level  flight  maintained  by  successive  corrections  may  be 
Interpreted  as  gradual  turning,  due  to  cumulative  effects  on  the 
endolymph.  To  demonstrate  such  effects,  it  may  be  desirable 
to  vary  the  magnitude  of  various  motion  cues  as  well  as  to  demon- 
strate them  with  full  fidelity.  DeBerg,  McFarland,  and  Showalter 
(1976)  have  already  shown  that  SAC  KC-135A  pilots  trained  with 
motion  in  a wide -body  aircraft  simulator,  either  with  or  without 
vision,  can  better  handle  outboard  engine  failure  on  takeoff  than 
pilots  trained  without  motion;  tests  were  run  only  in  the  simulator. 
Other  examples  would  include  flight  regimes  in  which  the  aircraft 
is  marginally  stable,  e.g.,  stall,  buffet,  high  angle  of  attack 
where  motion  cues  may  be  noticed  before  visual  ones.  For  all  of 
the  above  instances  where  simulator  motion  would  appear  to  be 
useful  for  training,  it  should  be  recognized  that  transfer  of  such 


80 


training,  with  or  without  motion,  to  the  aircraft  has  not  yet  been 
tested  or  demonstrated. 

The  military  services,  particularly  the  Air  Force,  are  conducting 
studies  concerned  directly  with  the  need  for  motion  in  simulators. 
These  studies  address,  in  straightforward  fashion,  such  significant 
issues  as  types  of  motion,  field  of  view,  pilot  experience,  flight 
task,  and  aircraft  type  (see  Table  16).  Attention  is  also  being 
given  to  auxiliary  motion  cueing  devices  (e.g.,  g-seats,  g-suits, 
shoulder  straps)  and  to  the  interaction  between  motion  cues 
(particularly  vision  and  platform  motion).  The  design  of  future 
studies  should  provide  measures  of  transfer  of  training  so  that 
cost-effectiveness  trade-offs  could  be  made  concerning  the  need 
for  platform  motion  for  particular  types  of  training  tasks  and  for 
training  pilots  at  various  levels  of  experience  (e.g.,  undergraduates, 
transition  training,  continuation  training).  It  may  also  become 
desirable,  for  experimental  purposes^  to  be  able  to  vary  selected 
response  characteristics  of  motion  systems  in  order  to  identify 
those  parameters  which  most  Influence  transfer  of  training.  These 
are  thought  to  be  angular  velocity  in  the  rotary  planes  and  linear 
velocity  and  acceleration  in  the  translation  planes.  Consideration 
should  be  given  to  modifying  experimental  flight  simulators  in 
order  to  make  such  tests  possible. 

B . Visual  Systems 

A flight  simulator  must  show  the  outside  visual  world  in  order 
to  be  useful  for  training  in  such  tasks  as  takeoff  and  landing, 
air-to-air  combat,  air-to-ground  attack,  carrier  landing,  and 
aerial  refuelling.  The  content  of  the  visual  scene  would  obviously 
depend  on  the  particular  application,  e.g.,  a landing  field  or 
aircraft  carrier  deck  for  takeoff  and  landing,  a military  installa- 
tion or  tanks  with  anti-aircraft  weapons  for  "ilr-to-ground  attack, 
a tanker  aircraft  with  a boom  for  aerial  refuelling,  and  so  on.  The 
case  of  landing  might  be  satisfied  by  a scene  with  limited  detail, 
(e.g.,  runway  shape,  identification  number,  center  stripes,  threshold 
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and  touchdown  zone  markings)  and  a field  of  view  provided  by  a 
single  CRT  (e.g.,  ^8°  horizontal  x 36°  vertical).  Air-to-ground 
attack  might  need  much  more  detail  (e.g.,  buildings,  roads, 
vehicles,  terrain  features,  ground-to-air  defense  weapons)  and  a 
wider  field  of  view  (the  largest  now  available  is  2M0°  horizontal 
X 160°  vertical).  Various  applications  tend  to  favor  a particular 
method  of  visual  simulation  and  the  characteristics  of  some  typical 
display  systems  are  shown  in  Table  I8  (taken  from  Johnson,  Knight, 
and  Sugarman,  1975).  Some  of  the  characteristics  shown  in  this 
table  can  be  Improved  (e.g.,  McDonnell  Douglas  Corporation  has 
announced  a Vital  TV  system  which  adds  twilight  and  day  scenes 
to  the  previous  night-only  capability;  General  Electric  has 
announced  a capability  for  2.7  arc  minutes  resolution,  instead  of 
7 arc  minutes,  and  more  scenic  detail  for  its  Compu-Scene  system) 
and  rapid  changes  in  the  capability  of  visual  simulations  should 
be  anticipated.  As  shown  earlier,  visual  systems  can  add  from 
$0.3M  to  $^1.5M  to  the  cost  of  a flight  simulator.  The  smaller 
cost  would  provide  a single-channel,  narrow  field-of-view,  night- 
only  scene,  consisting  entirely  of  light  points;  the  higher  cost 
provides  scenic  detail  and  a wide  field  of  view  for  the  pilot,  such 
as  In  ASUPT.  The  visual  system  can  easily  be  the  most  expensive 
component  of  a modern  flight  simulator  and  could  account  for  50  to 
60  percent  of  the  procurement  cost. 

Although  visual  systems  are  identified  primarily  by  the  data 
base  used  to  store  the  imagery,  e.g.,  model  board,  CGI  or  film, 
each  system  also  requires  some  means  for  processing  the  data  and 
presenting  it  for  observation.  A model-board  system  is  based  on 
a real,  scaled-down  world  of  miniature  buildings,  roads,  and 
mountains;  the  pilot  sees  a portion  of  this  as  a function  of  how 
he  maneuvers  his  aircraft.  An  *^ptical  probe  and  TV  camera  on  a 
gantry  moves  over  the  model  as  if  it  were  an  airplane.  Basic 
limitations  of  this  system  are  that  the  maneuvering  area  is  strictly 
limited  by  the  size  of  the  model  board  and  pronounced  optical 
distortion  due  to  limited  depth  of  view  as  the  probe  approaches 
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the  surface.  Since  the  maneuvering  area  Is  limited  to  an  equivalent 
of  about  5 by  15  miles,  pilots  soon  become  familiar  with  the 
terrain,  which  may  reduce  the  value  of  such  simulation  for  training 
for  air-to-ground  attack,  although  not  necessarily  for  landing. 

A CGI  (computer- generated  imagery)  system  store,  scenic  content 
in  digital'  form  and  calculates  visual  perspective  for  each  tele- 
vision frame  based  on  the  instantaneous  eye-point  position  and 
orientation  of  the  aircraft  in  three-dimensional  space.  The  gaming 
I area  can  be  large  (200  x 200  miles  in  one  current  device),  moving 

I objects  can  be  shown,  scenic  detail  is  flexible,  and  the  system 

; has  a great  ability  to  follow  aircraft  position  and  attitude  in 

space.  However,  scenic  content  is  abstract  and  the  surfaces  and 
^ objects  lack  texture.  The  display  Is  degraded  by  flashing  or 

streaking  of  the  image  when  the  velocity  limitations  of  the  system 
are  exceeded.  A CGI  with  a wide  angle  field  of  view  produces  a 
compelling  impression  of  movement  through  space.  It  is  reported 
? that  highly  experienced  pilots  do  not  notice  when  platform  motion 

[ is  turned  off  during  a demonstration  flight  on  a simulator  with  a 

wide  angle  CGI  system,  but  this  finding  has  not  been  tested 
systematically. 

Although  many  model  board  systems  remain  in  use,  they  will 
probably  be  replaced  by  the  CGI  systems  which  are  more  flexible 
and  cost  about  the  same  amount.  However,  there  is  only  one  known 
study  which  compares  the  transfer  of  training  from  such  systems  to 
aircraft;  when  used  for  landing  training  on  the  KC-135,  a CGI  and 
> a night-only  display  showed  slightly  more  transfer  than  a model 

board,  but  the  differences  were  not  significant  (J.  Thorpe  1977 
unpublished).  All  current  visual  systems  have  some  advantages  and 
, deficiencies.  Some  film  systems  are  still  in  use,  but  it  is 

difficult  to  believe  that  new  ones  will  be  procured.  Here,  the 
basic  data  consist  of  photographed  images,  on  70 -mm  film,  of  some 
F flight  path,  typically  an  approach  and  landing.  Deviations  from 

the  normal  flight  path  are  produced  in  the  simulator  for  moving  the 
optical  system.  Such  systems  have  good  resolution  and  brightness 
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and  are  less  expensive  than  the  other  storage  mechanisms  noted 
here;  however,  they  have  very  limited  maneuvering  flexibility 
from  the  normal  flight  path  and  their  use  would,  at  best,  be  limited 
to  approach  and  landing.  Many  combinations  of  data  storage, 
processing,  and  display  are  feasible;  the  advantages  and  disadvan- 
tages of  various  combinations  have  been  reviewed  by  Bliss  (1969); 
Drlskell  (197^)*  Johnson,  Knight,  and  Sugarman  (1975);  the  Committee 
on  Vision  of  the  National  Academy  of  Sciences  (1975);  and  Lewis 
(1970). 

Visual  systems  are  demonstrably  more  costly  than  motion 
systems  and  the  utility  of  flight  simulators  will  depend  critically 
on  their  contribution  to  a wide  variety  of  training  tasks.  The 
RDT&E  program  on  visual  simulators  Is  directed  primarily  towards 
Improving  the  technology  of  storage,  processing,  and  display  of 
visual  data.  A summary  of  expenditures  for  visual  simulation  for 
PY  1977  Is  shown  in  Table  19;  the  particular  projects  are  identified 
In  Appendix  C.  An  interesting  fact  Is  that  industry  spent  $3.2M 
In  PY  1976  (the  last  year  for  which  such  data  were  available)  for 
Independent  Research  and  Development  on  various  aspects  of  visual 
simulation,  obviously  related  to  the  anticipated  procurement  of 
flight  simulators  with  visual  systems.  Excluding  IR&D,  the  total 
budgeted  for  visual  simulation  in  PY  1977  is  $16. 3M;  about  60  percent 
for  the  Air  Force  alone.  Major  efforts  Include  the  development  of 
the  Army  Laser  Scan  Visual  System,  the  Navy  Aviation  Wide  Angle 
Visual  System  (AWAVS),  and  the  Air  Force’s  Electro-Optical  Viewing 
System. 

The  development  of  visual  displays  for  flight  simulators  Is 
driven  strongly  by  what  can  be  done  and  not  particularly  by  what 
is  needed  In  a display  to  make  it  cost-effective  for  training 
purposes.  About  85  percent  of  the  funds  shown  in  Table  19  are 
allocated  for  Advanced  and  Engineering  Development.  Projects  for 
PY  1977  and  PY  1978  which  may  contribute  to  clarifying  visual 
requirements  for  flight  simulators  are  listed  in  Table  20.  Almost 
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TABLE  19.  SUMMARY  OF  DOD  RDT&E  PROGRAMS  ON 

VISUAL  SIMULATION,  FY  1977  (PROJECTS 
IDENTIFIED  IN  APPENDIX  C) 

FY77 

ARMY 

6.2  Exploratory  Development  $ 340K 

6.3  Advanced  Development  882 

$1222K 


NAVY 

6.2  Exploratory  Development  1124 

6.3  Advanced  Development  3575 

6.4  Engineering  Development  447 

$5146K 

AIR  FORCE 

6.1  Research  40 

6.2  Exploratory  Development  800 

6.3  Advanced  Development  1385 

6.4  Engineering  Development  7700 

$9925K 

TOTAL  DOD  $16,293K 

IR&D  (FY  1976)  $3205K 


TABLE  20. 


PROJECTS  CONCERNED  WITH  VISUAL  REQUIREMENTS 
FOR  FLIGHT  SIMULATION,  FY  1977  and  FY  1978 


ARMY 

PE  62727A 

A230-02  Visual  display  technology 

Laser  generated  visual  displays. 

Development  and  specification  of  requirements 
for  a flight  training  research  simulator. 
Suitability  of  day  computer  generated  imagery 
for  flight  simulators  In  navigation  training. 
Terrain  model  board  and  SFTS  requirements 
(AF-IQ  weapons  system  simulator) 

NAVY 

PE  62757N 

F-55-525/671 1 Standards  for  visual  systems 
PE  63720N 

4781  Aviation  Wide-Anglet  Visual  System 

AIR  FORCE 
PE  61102F 

2313  Visual  motion  cue  analysis 
PE  52205F 

1123  Comparison  of  CGI,  model  board  and  night  only 
displays  for  KC-135A  pilots 
ASPT  runway  touchdown  zone  visual  requirements 
ASD/SD-24  area  of  Interest  display  evaluation 
TAC  A-10  training  research  program 
T-46  visual  display  parameter  evaluation 
ASPT  visual/motion  interaction  evaluations 
(vary  FOV)- 

Army  display  performance  test 

6114  Evaluate  area  of  Interest  dlsplcy  for  air  crew  training 
Determine  CIG  sensor  simulation  fidelity  requirements 
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all  of  these  studies  are  concernec  with  the  transfer  of  training 
of  particular,  existing  visual  simulation  systems.  The  size  of 
the  field  of  view  is  being  varied  in  some  of  the  ASUPT  studies 
concerned  with  the  need  for  platform  motion  discussed  previously. 
AWAVS  will  be  used,  in  an  off-line  mode,  to  prepare  Imagery  which 
can  be  used  in  studies  of  visual  fidelity. 

Unpublished  research  results  show  no  significant  differences 
in  landing  the  KC-135  for  pilots  trained  in  B-707  simulators  with 
motion  and  different  wide  angle  display  systems,  i.e.,  day  color 
CIG  (Boeing),  day  TV-model  board  (American  Airlines),  or  a night 
calligraphic  system  (American  Airlines);  Thorpe  (1977).  Some 
technical  options  in  visual  systems  will  be  evaluated:  e.g.,  area- 
of-interest  (hlgh-resolutlon  inset),  real  vs  virtual  image  display, 
and  improved  use  of  edges  in  CGI  data  processing.  Most  papers 
presented  at  the  1977  Image  Conference  (Williams  APB,  17-18  May 
1977)  were  concerned  with  equipment,  but  some  research  results 
were  also  reported.  Kraft,  Anderson,  and  Elworth  (1977)  showed  that 
point  sources  used  currently  to  indicate  runway  lights  in  a CGI 
night  scene  gave  pilots  the  impression  that  they  were  higher  on  a 
glide  slope  than  when  these  sources  were  attenuated  in  luminous 
intensity  to  compensate  for  atmospheric  attenuation  and  for 
excessive  depicted  size.  Crawford,  Topmiller,  and  Ritchie  (1977) 
reported  that  subjects  tend  to  overestimate  distances  under  "clear" 
and  "reduced  visibility"  conditions  in  a CGI  display,  although 
experienced  crew  members  are  more  accurate  than  naive  subjects; 
the  tests  Involved  slant  ranges  of  about  0.6  to  7 miles  on  a 
screen  with  a field  of  view  of  l8.5°V  x 22.5°H.  Overestimation 
was  reduced,  but  still  present,  when  more  detail  (called  "texture") 
was  added  in  the  experiment.  A literature  review  by  Ritchie  (1976) 
attempts  to  evaluate  information  from  experiments  on  visual  per- 
ception, the  history  of  art,  and  techniques  used  in  motion  picture 
animation  and,  thereby,  to  suggest  approaches  to  research  to 
improve  computer- generated  displays.  However,  there  appears  to 
be  neither  a systematic  program  nor  a plan  to  develop  the  test 


88 


facilities  which  would  be  needed  to  identify  the  required  perceptual 
characteristics  of  visual  displays  (e.g.,  resolution,  surface 
texture,  modelling  of  objects,  color)  in  order  to  establish 
specifications  for  such  devices  and  to  determine  the  areas  of 
technology  which  need  greatest  support,  based  on  criteria  of  maximum 
contribution  to  required  image  quality,  feasibility,  cost,  technical 
risk,  and  the  time  required  for  development.  There  is  a deficit 
in  our  research  literature  on  the  minimal  and  necessary  character- 
istics of  visual  systems  for  simulation.  The  pilot  will  probably 
want  the  real  world,  even  though  there  is  evidence  that  he  can  land 
his  airplane  if  we  provide  him  with  as  little  as  three  dots  of 
light  properly  oriented  on  the  ground  (Flexman).  There  seems 
little  reason  to  build  systems  with  the  highest  possible  fidelity 
without  knowledge  of  whether  or  not  they  are  needed.  Related  to 
the  urgent  need  for  development  of  visual  systems  is  an  equally 
pressing  need  to  develop  simulations  of  other  sensory  systems  such 
as  radar  images,  IR  displays,  LLLTV  displays,  and  possibly  of 
electronic  countermeasures.  The  research  budget  for  visual  simula- 
tion appears  to  be  $ilOK  (Air  Force  6.1). 

R&D  on  visual  simulation  needs  a focus  that  is  not  apparent 
in  the  current  budget  of  $16M.  It  is  important  to  distinguish 
between  what  may  be  seen  in  a visual  display  and  the  me-''  anisms 
that  are  used  to  generate  that  display.  The  pilot  sees  what 
is  in  the  display  and  presumably  is  not  much  concerned  with  how 
it  got  there.  Visual  displays  do  not  have  very  high  fidelity; 
there  is,  as  yet,  no  method  of  visual  simulation  in  which 
the  observer  cannot  tell  the  difference  between  a real  object  and 
that  shown  in  a visual  display.  This  is  quite  different  from 
auditory  simulation  where,  for  example,  an  observer  cannot  distinguish 
between  a musical  group  and  a sound  system,  provided  both  are  behind 
a curtain. 

Many  of  the  technologies  currently  available  to  store,  process, 
and  display  a visual  scene  are  shown  in  Figure  7.  The  performance 
requirements  for  a visual  flight  simulator  are  identified,  without 
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quantitative  values,  on  the  right.  These  values  have  not  been 
established  and,  in  recent  systems,  reflect  what  can  be  done  rather 
than  what  is  needed.  An  R&D  program  on  visual  simulation  is  needed 
to  establish  performance  requirements.  Basically,  this  Involves 
determining  the  transfer  effectiveness,  from  simulator  to  aircraft, 
of  training  with  simulations  of  scenes  that  differ  in  such  major 
visual  parameters  as  resolution,  field  of  view,  surface  texture  and 
scenic  content.  The  order  of  priority  for  these  studies  should 
approximately  follow,  in  decreasing  order,  the  cost  of  the  sub- 
systems needed  to  provide  these  visual  characteristics.  Since  the 
ASUPT  and  AWAVS  simulators  were  designed  to  be  used  for  experiments 
in  training,  some  of  these  visual  studies  could  be  conducted  at 
these  facilities.  Little  effort  has  been  made  to  examine  in 
detail  the  flexibility  or  the  availability  of  these  devices  for 
studies  of  visual  requirements.  It  may  well  be  that  the  use  of 
other  visual  devices,  or  the  development  of  new  ones,  may  be  needed 
for  an  effective  research  program  on  visual  simulation.  There  also 
exists  a large  body  of  literature  and  highly  qualified  scientific 
expertise  in  visual  perception  which  may  help  focus  an  experimental 
program  designed  fundamentally  to  establish  the  visual  requirements 
for  visual  displays  in  flight  simulators.  Information  concerned 
with  visual  thresholds,  e.g.,  size,  contrast,  and  brlghtnes.'^ , is  well 
established  and  there  are  good  models  which  predict  detection, 
recognition,  and  identification  of  objects.  It  is  believed,  however 
that  little  systematic  work  has  been  done  on  such  critical  matters 
pertaining  to  visual  simulation  as  field  of  view,  surface  texture, 
scenic  content,  and  the  amount  of  detail  required  within  objects;  the 
interested  reader  is  referred  to  Gibson  (1966),  Graham  (1965) » and 
Kaufman  (197^),  among  others.  There  is  no  recognized  measure  of 
visual  fidelity.  Measures  of  image  quality  are  widely  used  in  the 
design  and  evaluation  of  photographic  and  television  systems,  e.g., 
modulation  transfer  function.  Intensity  transfer  function,  and 
granularity  or  noise.  (See  Shade,  Biberman  1973).  Measures  of 
image  quality  are  concerned  with  the  ability  of  an  imaging  system 
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to  duplicate  the  real  world,  and  not  with  the  structure  and 
content  of  visual  scenes. 

Provisional  visual  requirements  can  be  derived  initially  from 
the  visual  specifications  for  ASUPT  and  AWAVS  modified,  to  the 
extent  that  Information  exists,  to  improve  known  limitations  of 
these  systems,  and  to  meet  standards  based  on  the  visual  research 
literature.  Then,  the  technologies  listed  in  Figure  7 should  be 
reviewed  to  identify  those  areas  where  improvements  appear  feasible, 
either  to  improve  visual  characteristics  and/or  to  reduce  costs. 

The  main  factors  to  be  assessed  appear  to  be  technical  feasibility 
and  risk,  development  time,  cost,  the  availability  of  qualified 
organizations  to  perform  the  work,  and  the  compatibility  of  the 
development's  schedules  with  those  for  the  anticipated  procurement 
of  simulators  which  could  incorporate  these  visual  devices.  The 
training  value  of  such  potential  improvements  is  largely  unknown. 

The  military  services  have^  of  course,  coordinated  their  R&D  programs 
in  the  sense  that  the  Air  Force  has  supported  the  development  of 
wide  angle  virtual  image  displays,  the  Navy  has  supported  wide  angle 
real  image  displays,  and  the  Army  has  supported  laser  displays. 
However,  it  is  believed  that  a coordinated  plan  for  research  on 
visual  simulation  technology  and  on  visua";  perception  as  suggested 
above,  does  not  exist  at  present  and  is  needed  to  provide  guidelines 
and  priorities  for  future  efforts  This  is  regarded  as  crucial 
because  of  the  high  relative  cost  of  visual  displays  in  flight 
simulators  and  of  their  major  significance  for  training  purposes. 


VI.  DISCUSSION 


Increased  dependence  on  flight  simulators  for  military 
flight  training  was  mandated  primarily  by  guidance  from  DoD 

V 

that  the  services  should  reduce  total  flying  hours.  The  policy 
was  the  result  of  congressional  pressure  related  to  the  "high 
cost”  of  flying.  If  present  plans  to  procure  simulators  are 
followed,  it  is  estim.ated  that  the  use  of  simulators  will 
permit  a reduction  of  total  flying  hours  by  percent  in  FY 
1978  and  by  17  percent  in  FY  1981.  Thus,  while  flight  simulators 
may  save  money  by  reducing  flying  hours,  it  is  also  necessary 
to  demonstrate  that  they  are  effective  for  training  purposes. 

If  the  use  of  simulators  is  extended  to  operational  training, 
it  will  become  necessary  to  demonstrate  that  their  use  does 
not  reduce  operational  readiness.  Pilots  cannot  bs  expected 
to  favor  reduced  flying  hours  particularly  if,  in  their  opinion, 
it  may  interfere  with  combat  readiness. 

Operating  costs  per  hour  of  current  simulators  are  about  5 
to  20  percent  those  of  comparable  aircraft.  This  suggests  that 
simulators  could  be  more  cost-effective  than  aircraft  for  train- 
ing, provided  that  simulator  time  to  reach  a specified  level  of 
performance  on  a flight  task  does  not  exceed  aircraft  time  for 
the  same  purpose  by  the  reciprocal  of  the  values  shown  above, 
i.e.,  by  not  more  than  about  20  to  5 times.  Considerable  trans- 
fer of  training  data  from  older  simulators  (and  a few  modern 
ones)  to  aircraft  are  well  within  this  limit  and  they  strongly 
imply  that  simulators  should  be  cost-effective.  The  amount  of 
transfer  is  not  constant  but  should  be  expected  to  vary  with 
such  factors  as  the  task,  the  rate  of  usage  per  pilot,  the 
experience  level  of  the  pilot,  the  particular  type  of  simu- 
lator, and  the  instructional  strategy  employed  in  the  training 
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program.  However,  the  conclusion  that  flight  simulators  a'^e  cost- 
effective  relates  effectiveness  with  ol-i  simulators  and  goi  'ralTy 
unspecified  instructional  strategies  with  current  operating  cost 
data  for  simulators  and  aircraft.  Given  improved  training  curricula 
and  advanced  simulators  with  Improved  instructional  facilities  and 
Improved  fidelity,  there  is  compelling  reason  to  expect  similar  or 
greater  cosc-benefits  In  the  future  without  loss  of  training 
effectiveness.  This  remains  to  be  demonstrated,  since  few  of  the 
advanced  simulators  are  In  actual  use.  In  three  current  cases,  It 
appears  that  the  procurement  cost  of  a flight  simulator  can  be 
amortised  wlthJn  periods  of  O.?^  to  ? years,  as  found  by  an  airline, 
the  Navy  (P-iC),  and  the  Coast  Guard  (Hll-'^PA  and  HH-3PK  In  these 
oases,  flight  performance  was  found  to  bo  the  same  as  or  superior 
to  that  observed  before  simulators  were  used  In  traltilng.  Prom 
these  studies,  it  Is  not  possible  to  separate  the  contributions  of 
the  simulators  and  of  the  Improved  training  curricula  to  the  observed 
levels  of  perlormanco.  Projections  submitted  bo  Congress  by  the 
PoD  suggest  that  the  median  amortisation  period  for  97  units  of  2^ 
types  of  simulators  will  be  ^t.8  years.  Clearly,  the  length  of  the 
amortisation  period  depends  not  only  on  the  effectiveness  of  the 
simulator  as  a training  device  (e.g.,  flight  hours  saved)  but  also 
on  the  rate  of  utilisation  and  on  various  assumptions  upon  which 
the  cost  estimates  are  based. 

All  current  estimates  of  savings  due  to  the  use  of  flight 
simulators  are  based  on  the  amount  of  flight  time  saved  after 
training  pilots  on  some  portion  of  the  curriculum,  either  in  the 
simulator  or  In  the  aircraft.  This  procedure  provides  a conserva- 
tive estimate  of  savings  because  It  overlooks  a well-known  fact 
about  training,  namely  that  the  learning  curve  has  an  asymptotic 
shape.  Additional  training  Improves  performance  by  diminishing 
increments.  Thus,  it  becomes  Important  to  determine  the  marginal 
productivity  of  flight  simulators  for  various  types  of  tasks.  Tnere 
Is  a cross-over  dotermlned  by  comp.  "Ing  i.he  Incremental  Transfer 
Effectiveness  Ratio  of  the  simulator  to  the  slnmlator/aircrnft 
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operating  cost  ratio,  after  which  additional  training  in  the 
simulator  is  no  longer  cost-effoctive.  Determination  of  the 
Incremental  Transfer  Effectiveness  Ratio  for  this  purpose 
requires  an  experimental  design  in  which  one  of  the  variables  is 
amount  of  time  spent  in  the  simulator.  This  appears  to  have  been 
accomplished  only  by  Povenmire  and  Roscoe  (1973)  for  the  GAT-1 
simulator,  and  Jacobs  and  Roscoe  (1975)  for  the  GAT-2  simulator, 
both  for  training  student  pilots.  The  need  for  such  studies  is 
recognized  and  studies  are  scheduled  by  the  Air  Force  for  FY  1979 
and  later.  These  should  consider  not  only  how  the  rate  of  improve- 
ment changes  in  the  simulator  but  in  the  aircraft  as  well. 

Most  or  all  of  the  data  describing  the  "eft ectiveness"  part 
of  the  cost/effectiveness  ratio  was  derived  from  transfer  of 
training-type  studies  where  the  criterion  .1s  savings  in  flight  time. 

A realistic  perspective  on  simulator  effectiveness  requires  that 
other  dimensions  be  considered  as  well.  For  exam.ple,  training  on 
the  flight  simulators  used  by  the  Coast  Guard  at  Mobile,  Alabama, 
may  have  contribute'^  to  saving  two  aircraft  that  had  Inflight 
failures.  In  the  past,  l.e.,  prior  to  flight  simulator  training 
on  the  specific  emergency,  aircraft  were  lost  when  flight  failure 
occurred.  The  dollar  savings  that  occurred  because  of  the  success- 
ful outcome  of  these  two  emergencies  is  supposedly  more  than  the 
initial  cost  of  the  entire  training  facility.  The  fact  that  we 
cannot  conduct  controlled  experiments  in  this  area  of  benefits  does 
not  mean  that  the  Increments  in  safety  attributable  to  flight  simu- 
lators are  not  important. 

Other  measures  of  simulator  training  effectiveness  that  should 
receive  attention  might  Include  the  following: 

a.  Level  of  skill  and  procedural  ability  retention  achieved 
via  flight  simulator  training  versus  aircraft  training. 

b.  The  adaptive  capacity  of  the  pilot  to  react  to  situa- 
tional exigencies. 

c.  The  effect  on  the  pilot's  workload  potential. 
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d.  The  effect  on  the  reliability  and  consistency  of  the 
pilot's  performance. 

e.  The  effect  on  the  pilot's  sensory  responsiveness  and 
vigilance  as  well  as  judgment  in  decision  making. 

f.  The  effect  on  the  pilot's  self-confidence  and  acceptance 
of  the  training. 

The  fact  that  we  do  not  have  adequate  measures  of  the  dimensions 
of  effectiveness  only  emphasizes  our  need  for  a more  thorough  and 
comprehensive  structuring  of  simulation  research. 

Representative  values  for  the  procurement  cost  of  current 
flight  simulators  are  shown  in  Table  21.  These  vary  from  $1.1M 
for  the  T-3^C  instrument  flight  simulator  to  $2^.0M  for  the 
B-1  mission  flight  simulator.  It  is  conceivable  that  the  procure- 
ment cost  of  a modern  simulator  may  approach,  or  perhaps  exceed,  the 
procurement  cost  of  an  airplane.  That,  in  itself,  is  not  an  argument 
against  use  of  the  simulator  because  the  simulator  may  still  be 
mere  cost-effective  on  a life-cycle  basis  for  specific  types  of 
training  than  the  airplane.  We  have  already  shown  that  the  simula- 
tor has  a favorable  operating  cost  and  that  there  is  extensive 
evidence  that  performance  learned  in  the  simulator  transfers  to 
the  airplane  and  saves  flight  time.  A factor  that  favors  the 
simulator  and,  of  course,  contributes  to  the  lower  operating  cost 
(to  the  extent  that  fixed  costs  are  significant),  is  that  it  can 
be  used  many  more  hours  per  year  than  an  airplane.  Utilization 
for  a simulator  can  exceed  5000  hours  per  year  (l8  hrs  per  day  x 
6 days  a wee'  x 50  weeks  per  year  = 5^00  hours)  while  military 
aircraft  utilization  is  in  the  range  of  about  500  hours  per  year, 
according  to  the  estimates  shown  in  Table  22.  On  economic  grounds 
alone,  it  is  likely  that,  over  their  life  cycles,  flight  simulators 
will  remain  less  expensive  to  own  and  operate  than  aircraft. 
Obviously,  the  other  critical  issue  is  whether  flight  simulators 
are  effective  for  training,  so  that  the  cost-effectiveness  of 
simulators  and  aircraft  for  training  can  be  directly  evaluated. 


TABLE  21 . REPRESENTATIVE  PROCUREMENT  COSTS  FOR  FLIGHT 
SIMULATORS.  (SOURCE:  DoD  REPORT  ON  FLIGHT 
SIMULATION,  1977) 


Simulator 


Procurement  No . Average 

Period  (FY)  Procured  Cost 


Army 


UH-1  Synthetic  Flight  Training 

76-78 

12 

$ 3.31 

System 

CH-47  Synthetic  Flight  Training 

79 

2 

8.2 

System 

AH-1  Synthetic  Flight  Training 

79 

3 

10.9 

System 

UTTAS  Synthetic  Flight  Training 

79 

2 

7.2 

System 

« 

f 

A-6  Night  Car'^ier  Landing  Trainer 
CH-53  Operational  riiqht  Trainer 

77-78 

2 

7.9 

77 

1 

4.9 

EA-6B  Part  Task  Trainer 

77 

1 

5.4 

E-2C  Part  Task  Trainer 

78 

1 

1.3 

P-3C  Operational  Flight  Trainer 

78 

1 

6.5 

S-3A  Weapon  System  Trainer 

76 

1 

T-34C  Flight  Instrument  Trainer 

78 

10 

1.1 

F-18  Trainer 

79 

1 

23.1 

Force 

A-IO  Training  Flight  Simulators 

76 

2 

6.6 

Instrument  Flight  Simulators 

77-78 

10 

5.1 

B-1  Mission  Flight  Simulators 

78-79 

3 

24.0 

C-5  Cockpit  Procedure  Trainers/ 

77 

3 

3.7 

Nav. 

C-130  Cockpit  Procedure  Trainers 

76 

2 

3,9 

Mission  Simulators 

77-78 

5 

6.3 

C-141  Cockpit  Procedure  Trainers 

77 

7 

1.3 

F-15  Instrument  Flight  Trainers 

76-78 

7 

4.0 

F-16  Training  Flight  Simulators 

78 

4 

9.5 

F-111  Mission  Simulator 

77 

1 

9.9 

T-37/38  Instrument  Flight  Simulators 

76-78 

18 

3.4 

*A  value  of  $4.2M  is  used  in  Browning,  Ryan,  Scott  and  Smode 
(1977)  p.76. 
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TABLE  22. 


PROJECTED  AVERAGE  ANNUAL  FLYING 
HOURS  PER  AIRCRAFT  ACCORDING  TO 
MISSION,  FY  1981 


Mission 

Undergraduate  flight  training 
Transition/training 
Mission/not  industrially  funded 
Mission/industrially  funded 
Support  flying 

Average,  all  missions 


Regular  Regular 


Navy 

Air  Force 

574  hrs 

602  hrs 

430 

303 

422 

323 

«• 

861 

485 

503 

457  hrs 

430  hrs 

Source;  Navy  Aircraft  Program  Data  File,  Jan-  (Secret) 

USAF  Program,  Aerospace  Vehicles  and  Hours, 

Vol.  I,  by  M/D/S,  PA  FY-78-P0M,  7 May  1976  (Secret) 


98 


rvu* 


Cost  data  needed  to  evaluate  the  cost-effectiveness  of 
alternative  training  programs  are  not  now  being  collected  in  a 
systematic  and  comparable  fashion  useful  for  trade-off  studies 
between  simulators  and  aircraft  (Baron,  197^),  This  is  particu- 
larly the  case  for  comparing  the  training  programs  of  different 
services . 

The  data  reporting  systems  that  do  exist  are  generally  limited 
to  extracting  full  costs  of  given  training  programs  from  bass 
accounting  systems  for  the  purpose  of  setting  reimbursement  rates 
for  inter-service  or  foreign  student  training.  Except  in  the  area 
of  fl/ing-hour  costs,  there  is  no  attempt  in  such  systems  to 
associate  or  correlate  types  and  levels  of  resources  consumed  with 
Increments  in  training  ]oads  or  with  the  particular  activities 
within  training  programs . The  development  of  such  data  entails 
costs,  and  one  would  anticipate  that,  in  the  absence  of  specific 
requirements  and  models  for  estimating  training  costs,  necessai’y 
data  would  be  found  lacking.  There  are  large  ai’eas  of  commonality 
in  resource  requirements  between  flight  training  and  other  facets 
of  peacetime  military  operations.  Tn  these  common  areas  the 
applicable  data  can  be  considered 'available . However,  there  remain 
significant  resource- consuming  activities  that  are  peculiar  to  the 
training  establishment  for  which  requisite  data  have  not  been 
developed.  This  is  especially  true  in  the  area  of  training  equip- 
ment costs  (including  flight  simulators)  and  direct  instructional 
and  instructional  support  personnel  requirements. 

On  the  basis  of  these  findings,  the  present  investigation 
turned  to  the  particular  costs  attributable  to  flight  training. 

(See  Vol.  II)  Basic  considerations  surrounding  the  role  of  flight 
simulators  (and  extendable  to  considerations  of  other  training 
equipments  and  resources)  were  developed  from  traditional  economic 
analysis.  A model  was  formulated  that  emphasizes  analyses  of 
cost  trade-offs  between  flight  and  flight  simulation.  A result 
of  this  formulation  is  to  identify  the  general  types  of  data  that 
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would  be  required  for  its  implementation,  and  the  availability  of 
these  types  of  data  has  been  investigated  for  each  of  the  three 
services.  The  model  is  neither  sufficiently  detailed  nor  complete 
to  serve  as  an  analytical  tool.  Rather,  it  provides  a guide  for 
further  development  of  analytical  methods  and  data  collection 
systems  by  the  military  services  in  order  to  assess  the  cost  impacts 
of  proposed  training  program  changes. 

Deficiencies  in  the  data  base  limit  the  ability  of  the  sei’vices 
to  estimate  cost  impacts  of  flight  training  simulators.  There  is 
also  a need  for  training  effectiveness  data  in  order  to  assess  net 
values  of  program  alternatives,  including  substitution  of  simulation 
for  other  modes  of  training  and  evaluations  of  altei'natlve  simulator 
configurations.  Development  of  an  adequate  data  base  is  a first 
order  of  business,  since  methods  and  analytical  models  that  might 
he  developed  are  useful  only  to  the  extent  that  they  are  consistent 
with  the  form  in  which  data  can  be  developed. 

The  services  are  using  different  strategies  to  procure  flight 
simulators.  The  Army  is  following  a step-by-step  approach  while 
the  Air  Force  is  planning  a series  of  large-scale  procurements. 

Each  type  of  strategy  carries  a risk.  Should  simulators  prove 
to  be  cost-effective,  cost  savings  would  be  lost  by  the  Army 
approach.  If  they  do  not,  especially  in  the  area  of  use  for 
training  on  skill  maintenance,  the  Air  Force  program  would  result 
in  a large  investment  in  devices  that  do  not  fully  serve  their 
intended  purposes.  Judging  which  type  of  program  is  more  appro- 
priate is  beyond  the  scope  of  this  paper. 

It  is  clear  from  many  studies  conducted  since  about  1950 
that  flight  simulators  are  effective  training  devices.  No  attempt 
was  made  to  review  the  earlier  studies  in  detail,  because  th-'y  were 
conducted  on  simulators  that  have  long  been  obsolete  and  use  '• 
training  procedures  that  are  unclear  or  difficult  to  reconstruct. 
Many  recent  and  relevant  studies  are  available  for  examination. 
Measures  of  transfer  of  training  were  evaluated  or  calculated 
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where  the  required  data  were  available  in  20  studies  concerned  with 
the  effectiveness  of  flight  simulators  conducted  over  the  period 
of  1967  to  1977.  The  crucial  aspect  in  all  of  these  studies  is 
not  whether  a pilot  can  improve  his  performance  in  a simulator 
but  the  extent  to  which  skills  learned  in  a simulator  can  be 
transferred  to  an  aircraft.  There  is  a consistent  finding  in 
these  studies  that  skills  learned  in  a simulator  carry  over  to 
the  aircraft.  The  median  TER  is  0.^5,  which  may  be  taken  to  be 
the  fraction  of  time  spent  in  the  simulator  which  carries  over  as 
time  saved  in  the  aircraft,  compared  to  a control  group  which 
was  trained  only  in  the  aircraft.  In  fact,  the  TER's  vary  from 
almost  0 to  0.9.  Clearly,  it  would  be  important  to  identify  the 
factors  which  lead  to  small  or  large  amounts  of  transfer  and  thi.'’ 
can  be  accomplished  only  by  a systematic  and  coordinated  research 
program.  An  attempt  to  interpret  the  different  amounts  of  transfer 
found  in  the  studies  presently  available  is  not  warranted  due  to 
limited  information  about  the  flight  curricula,  tasks,  and  performance 
characteristics  of  the  simulators  that  were  used.  Thus,  R&D  is 
needed  to  establish  the  actual  TER’s  for  various  tasks  and  training 
curricula  on  currently  available  simulators.  If  time  in  the 
simulator  is  included  as  a variable  (i.e.,  several  experimental 
groups  with  different  amounts  of  time  in  the  simulator),  it  will 
be  possible  to  approximate  the  shape  of  the  learning  curve  and 
the  point  at  which  the  simulator  reaches  its  marginal  utility  as 
a training  device.  That  information  is  needed  to  relate  Incremental 
training  effectiveness  to  cost  of  training  and  the  basis  on  which 
to  determine  when  simulators  and  aircraft  can  each  be  used  on  a 
cost-effective  basis. 

Most  moQsrn  flight  simulators  possess  sophisticated  capabilities 
for  instructing  pilots  and  measuring  their  performance.  These 
include,  for  example,  the  ability  to  insert  predetermined  conditions 
./hlch,  if  uncorrected,  lead  to  malfunctions  during  flight;  to 
freeze  flight  conditions,  or  to  replay  maneuvers  for  purpose 
review,  or  to  repeat  a maneuver  from  some  convenient  starting 
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point;  to  demonstrate  automatically  certain  maneuvers  or  preferred 
procedures;  and  to  score  pilot  performance  and  to  provide  the 
student  with  diagnostic  Information  concerning  his  performance. 

One  of  the  main  considerations  in  the  design  of  ASUPT,  when 
it  was  conceived  in  1967,  was  to  provide  facilities  for  research 
concerned  with  such  issues  as  performance  measurement  and  instruc- 
tional strategies  in  undergraduate  pilot  training.  Our  ability 
to  establish  the  effectiveness  of  alternative  ways  of  training  will 
be  no  more  accurate  than  our  ability  to  measure  the  performance 
of  pilots  in  simulators  and  in  aircraft.  Recent  reviews  of  this 
topic  may  be  found  in  Rusis,  Spring  and  Atkinson  (1971),  Koonce 
(197^),  and  Waag  et  al  (1975).  Almost  all  of  the  data  cited  in 
this  report  to  demonstrate  the  effectiveness  of  flight  simulators 
are  based  on  subjective  ratings  of  pilot  performance  in  simulators 
and  in  aircraft.  Much  previous  research  has  been  devoted  to 
objective  measurement  of  pilot  performance,  but  the  current  method 
still  uses  instructor  pilots  to  judge  whether  students  have 
performed  various  maneuvers  within  specified  tolerance  ]imits. 

Given  proper  training,  such  judgments  have  a high  reliability, 
i.e.,  correlations  of  about  0.7  to  0.8  on  repeated  measurements 
between  rides  and  between  observers.  Ocjective  and  automated 
performance  measurements  have  been  used  in  many  studies  in  simula- 
tors and  aircraft,  but  the  judgment  of  Instructor  Pilots  is  still 
the  basic  means  of  evaluating  pilot  performance  in  routine  flight 
training.  All  services  conduct  research  on  performance  measure- 
ment of  pilots  and  aircrew.  However,  this  topic  should  receive 
greater  priority,  considering  the  contribution  that  objective 
performance  measures  could  make  to  answer  many  questions  about  the 
optimum  utilization  of  flight  simulations. 

It  cannot  escape  notice  that  the  effective  development  and 
use  of  flight  simulators  for  training  purposes  is  influenced  by 
factors  other  than  RDT&E,  the  major  concern  of  this  paper.  The 
limited  use  of  simulators  In  the  past  was  not  a dominant  issue 
as  long  as  sufficient  funds  were  available  for  military  flying. 
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Obvious  limitations  In  the  performance ’ of  flight  simulators  and 
a low  regard  for  their  training  value  both  contributed  to  their 
low  usage  and  to  the  lack  of  support  for  their  improvement. 

Interest  of  the  airlines  provided  the  initial  impetus  towards  the 
improvement  of  flight  simulators  over  the  last  10  years,  and 
additional  support  came  from  Congress  and  the  DoD  as  a consequence 
of  the  oil  embargo  and  of  budget  pressure  to  reduce  military 
flying.  Still,  user  acceptance  will  ultimately  determine  whether 
the  military  services  can  realize  the  potential  savings  and 
efficiencies  afforded  by  the  use  of  flight  simulators.  Strong 
direction  and  support  at  top  levels  in  the  services  and  the  DoD 
will  be  required  to  Influence  an  effective  use  of  simulators. 

Despite  their  large  aggregate  expense,  no  procurement  of 
flight  simulation  equipment  is  largt  enough  to  m.eet  the  criteria 
of  a DSARC  review.  The  Defense  Systems  Acquisition  Review  Council 
(DSARC)  reviews  systems  programs  having  an  anticipated  cost  of 
$75  million  in  research,  development,  test,  and  evaluation  or 
$300  million  in  production  (DoD  Diiectives  5000.1,  January  I8,  1977; 
5000.2,  January  I8,  1977;  5000.26,  January  21,  1975).  The  training 
system  is  a relatively  mi.ior  itqm  in  the  procurement  cost  of  an 
aircraft  which  does  not  meet  these  criteria;  the  aircraft,  of 
course,  does.  The  training  system  does  not  appear  to  receive 
major  attention.  Yet,  the  life- cycle  cost  impact  of  a particular 
type  of  flight  simulator  may  be  large  when  it  is  procured  with 
(or  without)  such  features  as,  for  example,  motion  platform,  wide 
angle  visual  system,  or  instructional  and  performance  scoring 
capabilities.  The  findings  in  this  paper  suggest  that  little 
valid  data  are  yet  available  on  the  cost-effectiveness  of  current 
flight  simulators,  and  this  applies  especially  to  the  cost- 
effectiveness  of  their  major  components.  Flight  simulators  are 
procured  typically  as  part  of  the  aircraft  weapon  system  develop- 
ment under  the  control  of  the  program  manager.  However,  they 
may  also  be  procured  by  separate  funding  if  they  are  deve]oped 
after  the  aircraft  system  has  been  acquired,  e.g.,  the  B-52  flight 
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simulator.  The  key  issue  is  to  make  sure  that  the  design  and 
procurement  of  flight  simulators  are  evaluated  in  terms  of  their 
impact  on  life-cycle  costs,  whether  at  DSARC  or  otherwise. 

However,  the  management  issues  which  would  have  to  be  resolved 
in  order  to  implement  such  a policy  were  beyond  the  scope  of  this 
study. 

An  increased  use  of  flight  simulators  would  appear  to  be 
supportable  on  the  basis  of  their  cost-effectiveness  for  under- 
graduate, transition,  and  continuation  training.  The  limits  to 
this  argument  are  not  apparent  at  the  moment.  Thus,  it  is  legitimate 
to  be  concerned  with  the  extent  to  which  the  savings  possible  by 
substituting  training  in  flight  simulators  for  aircraft,  particularly 
in  the  case  of  continuation  training,  might  lead  to  undesirable 
consequences  for  combat  readiness.  Some  minimum  amount  of  flying 
aircraft  appears  necessary  to  exercise  the  systems  which  would 
support  military  combat  flying,  such  as  logistics,  maintenance, 
servicing,  protection,  repair,  transportation,  and  command  and 
control.  Total  system  capability,  as  well  as  flight  skills,  must 
be  maintained,  and  it  would  be  a narrow  view  of  flight  training 
which  disregarded  this  contribution  to  military  readiness.  A 
program  which  would  attempt  to  establish  the  minimum  necessary 
amount  of  flying  appears  Just  as  Important  as  one  to  determine 
the  most  cost-effective  use  of  flight  simulators. 
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APPENDIX  A 


NOTE: 
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VARIABLE  OPERATING  COSTS  OF  SOME  SIMULATORS 
AND  AIRCRAFT,  FY  1975  AND  FY  1976 


These  data  summarized  in  Volume  1,  Chapter  2, 


A-1 


Table  4 


i 
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Description 
Air  Force 


Operating  cost  per  hour 
Simulator  Aircraft 


A-2 


Cost  Ratio 
Simulator/ 
Aircraft 


t ? 

^ « 

S-  f 

B-520  Flight  Trainer 

$ 86 

$2801 

i 

a 1 

Elect.  Warfare 

65 

1*  ; 

Bomb/Nav. 

51 

b-  1 

Gunnery 

24 

1 ‘ 

B-526  Flight  Trainer 

71 

2841 

1 

Elect.  Warfare 

74 

Bomb/Nav. 

67 

* 

1 

Gunnery 

26 

? 

& 

» 

B-52H  Flight  Trainer 

73 

2630 

Elect.  Warfare 

77 

1 

Bomb/Nav. 

68 

1 

g 

Gunnery 

26 

f 

FB-111  Weapon  System 

193 

1951 

h 

Bon^/Nav. 

238 

r 

Egress 

229 

i; 

SR-71  Weapon  System 

181 

- 

m 

r 

: • 

KC-135  Flight  Simulator 

70 

1595- 

0.04 

i , 

k 

F-4C  Weapon  System 

158 

1277 

0.12 

1 

F-4D  Weapon  System 

120 

1255 

0.10 

1 • 

F-4E  Weapon  System 

88 

1220 

0.07 

1 ? 

1 

RF-4C  Weapon  System 

81 

1092 

0.07 

1 

F-lllA  Flight  System 

179 

2240 

0.08 

1 

F-lllD  Flight  System 

100 

2240 

0.04 

r 

1 - 

F-lllE  Flight  System 

184 

2240 

0.08 

U f 

s- 

F-lllF  Flight  SystCT 

93 

2240 

0.04 

t '- 

F-106  Mission  Trainer 

114 

1014 

0.11 

i 

1 ^ 

A-7D  Weapon  System 

82 

1024 

0.08 

1 ? 

S 

a. 

C-5A/B  Flight  Simulator 

100 

3610 

0.03 

? 

C-141  Flight  Simulator 

93 

1272 

0.07 

Reference 


AFR  173-10 
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I 

i 

i 

I 

\ 
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I 

[ 

t 

i 

i 
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Cost  Ratio 


Operating  cost 

oer  hour 

Simulator/ 

Description  Simulator  A 

ircraft 

Aircraft 

Reference 

Air  Force  Continued 

C-130E  Flight  Simulator 

97 

638 

0.15 

AFR  173-10 

C-135  Flight  Trainer 

169 

109C 

0.16 

n 

CH-3  Flight  Simulator 

109 

352 

0.31 

II 

HH-53  Flight  Simulator 

109 

579 

0.19 

II 

T-37  (T4)  Flight  Simulator 
T-38  (T-7/T-26  Flight 

9 

224* 

0.02 

II 

Simulator 

10 

518* 

0.02 

II 

bm. 

UH-1  Flight  Simulator 

38 

190* 

0.02 

Directorate  of  Cost 
Analysis,  Comptrol- 
ler of  the  Armyf 
December  1976 

CH-47C  Flight  Simulator 

94 

858 

o.n 

n 

Wi-IQ^  Flight  Simulator 

69 

234 

0.29 

II 

CH-54  Flight  Simulator 

- 

1393 

- 

II 

CH-6  Flight  Simulator 

- 

63 

- 

II 

DH-58  Flight  Simulator 

- 

67 

- 

II 

TH-55  Flight  Simulator 

- 

66 

- 

II 

Navz 

S-3A  Flight  Simulator 

200 

501 

0.40 

Aircraft  Program 
Data  File,  Jan.  197j 

F-4  (Navy)  Flight  Simulator 

- 

1169 

- 

It 

P-3C  2F69D  Flight  Simulator 

134 

602 

0.22 

II 

2F87F  Flight  Simulator 

144 

602 

0.24 

It 

Coast  Guard 

HH  52A  VCTS 

504“ 

0.12 

Isley  et  al  1974 

HH  3F  VCTS 

59“ 

815“ 

0.07 

II 

P 

II 


!S 

i| 

H 


\1 


-4» 

i| 

■1 

i 

il 

::l 


A-3 


— j*_ 


I 

I 

i- 

I 

i- 


1 

t 

1 

1 

Description 

Operating  cost 
Sfmulatbr"' 

per  hour 
Aircrart 

Cost  ratio 
Simulator/ 
Aircraft 

Reference 

s 

f 

Airlines 

t 

i 

1 

‘i 

B-707 

Flight 

Simulator 

$ 213’ 

$ 935 

0.23 

Civil  Aeronautics 
Board  (1976)® 

\ 

i 

B-737 

Flight 

Simulator 

140 

599 

0.23 

H 

1 

B-727 

Flight 

Simulator 

140 

735 

0.19 

tl 

r 

B-747 

Flight 

Simulator 

275’ 

2358 

0.12 

11 

\ 

DC-8 

Flight 

Simulator 

150 

1107 

0.14 

M 

? 

DC-10 

Flight 

Simulator 

175 

1341 

0.13 

II 

i-i 


^USAF  Cost  and  Planning  Factors,  173-10,  20  January  1977 

^Includes  base  maintenance  labor 

^Reimbursement  rate  for  U.S.  government  agencies 

‘‘Assumes  75  percent  utilization  of  simulator,  12  hr  x 5 days  x 48  weeks 

’Average  of  3 simulators 

’Operating  expenses  per  block  hour,  (excluding  crew),  trunk  airlines, 
domestic  operations,  1975;  simulator  cost  data  from  private  sources. 
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APPENDIX  B 


SUMMARY  OF  STUDIES  WHICH  EVALUATE  THE 
EFFECTIVENESS  OF  FLIGHT  SIMULATORS 
FOR  VARIOUS  TYPES  OF  TRAINING,  1939-1977* 


*NOTF:  This  appendix  Is  based  largely,  but  not  entirely,  on 
summaries  which  appear  In  papers  by  Carter  (1971),  Michell  (1972) 
and  Diehl  and  Ryan  (1977).  Some  of  the  studies  cited  In  these 
papers  were  not  available  for  review.  Studies  are  Identified 
In  References. 


TABLE  B-1.  SUMMARY  OF  STUDIES  ON  THE  EFFECTIVENESS  OF  FLIGHT  SIMULATORS 


TABLE  B-1  (Continued) 


TABLE  B-1  (Continued) 


appendix  c 


rdt&e  projects  of  the 

VISUAL  SIMULATION,  FY 
( IR&D)  , FY  1976 


MILITARY  SERVICES  ON 
1977  AND  OF  INDUSTRY 


C-1 


ARMY 

^imk 


A230-02  Visual  Display  technology 
Wide  angle  laser  scan 
360°  annular  visual  system 
Opticul  image  display 
Visual  simulation  analysis 


$ 340 


63209A 


DB-39 


Flight  simulation  components 
CGI  computational  technology 
Digital  processing  of  imagery 


$ 882 


NAVY 


FY77 

62757N 

F-55-522  Training  NTEC 

F-55-525  Human  Engineering.  NTEC,  NADC.  PMTC, 

NAMRL,  NWC 

4751  Cost  effective  simulation  in  flight 

training  $100 

4742  Computer  generated  visual  displays 

for  training  125 

3714  Forward  looking  infrared  simulation 

in  Naval  training  devices  45 

3718  Holography  for  carrier  landing  47 

4744  Generalized  VTOL  simulation  mathe- 
matical model  45 

5714  TV  projection  system  40 

5742  Flight  simulation  system  test 

technology  14 

6711  Standards  for  visual  systems  33 

7711  Holographic  displays  for  training 

devices  30 

6714  Laser  air  to  ground  and  air  to  air 

weapon  delivery  systems  50 

3719  Optical  memory  for  sensor  simulation  60 

5741  Simulation  computing  techniques  115 

6716  Holographic  memory  for  training 

applications  38 

6718  Advanced  sensor  simulation  utilizing 

charge  coupled  devices  62 

6722  High  resolution  CCTV  multiple  target 

insertion  for  Nav.  tng.  devices  53 

6724  Solid  state  image  sensors  7 

7714  Multiple  image  display  system  for 

periscope  navigation  50 

7716  Optical  systems  for  training  device 

development  30 

7719  360°  non-programmed  visual  display  150 

7715  Lasers  for  training  device  development  30 


$1124 

63720N 

WPN  09  Training  devices  technology.  NTEC 

4781  Aviation  wide  angle  visual  system 

(AWAVS)  $3575 

647 03N 

SPN  47  Laser  and  holographic  applications  $ 447 

C-3 
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AIR  FORCE 


PY7/ 

61102F 

2313  Human  resources.  OSR 

Visual  motion  cue  analysis 

$ 

40 

62205F 

6114  Simulation  techniques  for  AF  training 

CIG  image  improvement 

$ 

62 

High  res.  color  projector 

45 

Multiviewer  display 

63 

Multiviewer  display 

58 

CIG  edge  utilization 

75 

Schlieren  display 

75 

Sensor  characterization 

,50 

Sensor  data  base 

70 

Sensory  modeling 

119 

lOS  display  evaluation 

70 

Simulation  software 

60 

Simulator  testing 

53 

$ 

800 

63227F 

1958  Training  simulator  technology  integration. 
AFHRL-FT 


Holographic  monochrome  visual  display  $ 625 
Holographic  color  visual  display  150 
High  resolution  color  camera  30 
High  resolution  liquid  crystal  projector  100 
Wide  angle  multiviewer 

Advanced  sensor  simulation  system  350 
Alternate  sensor  implementations 


$ 1255 

2364  Advanced  CIG  visual/sensor  system  (plus 

$25K  in-house)  $ 130 


C-4 


FY77 

$ 800 
2700 
1700 

600 

400 

500 

1000 

$7700 


DEFENSE  AGENCIES^  FY77 

IR&D 

Flying  Training  Technology 

0509-76DL  Air  Combat  visual  simulation 

Goodyear  Asrosp.  Corp.  $ 450 

7048  Advanced  Tactical  fighter  simu- 

lation. McDonnell  Douglas/ 

McDonnell  Acft  Co.  224 

$ 674 

Simulation  technology  for  training 

76005401  Digital  visual  hardware  develop- 
ment. Image  Gen.  Corp.  Singer 

76005402  Digital  visual  software  studies 
scene  content.  Singer 

76005414  Development  of  high  resolution 
color  monitor  Singer 

76005444  Wide  angle  display  system  eval. 

Singer 

75005433  Wide  angle  digital  image  gen. 
display.  Singer 

76005405  Advanced  simul.  tech,  software 
systems.  Singer 

76005432  Calligraphic-digital  gen.  visual 
system.  Singer 

*76005445  Laser  camera  system  study.  Singer 

76D5C53  CGI  system  technology.  General 
El ectric 

76D5C55  Electro-optical  viewing  system 
Sim.  GE 

*76D5C57  High  resolution  digital  radar  land 
mass  simulation.  GE 

*7047.01  Development  of  adv.  simulation 
concepts.  McDonnell  Douglas 


*Same  figures  also  used  for  training  devices 

^Note:  All  data  on  IR&D  taken  from  "FY  78-82  Research  and 
Technology  Plan,  Part  III,  Air  Force  Human  Resources  Laboratory, 
15  August  1976.  Data  apply  to  FY  1976. 
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$ 100 
200 
80 
200 

425 

24 

15 

225 

60 

350 

321 


DEFENSE  AGENCIES  Continued  FY77 


Simulation  technology  for  training,  cont'd  ^ I 

' I 

74R102  Area  of  Interest  display  technology  1 

for  GCI.  GE  $ 44  | 

74R103  GCI  terrain  presentation.  GE/  . | 

Valley  Forge  Space  Center  43  | 

75RC04  Advanced  GCI  architecture.  GE/  I 

Valley  Forge  Space  Center  55  1 

74R105  Advanced  GCI  data  base  technology. 

GE/Valley  Forge  Space  Center  9 

5001.01  Visual  simulation  technology  studies. 

McDonnell  Douglas  Corp.  1 

Electronics  Co.  300  I 

60604002  IR&LLTV  simulation  study.  Honey-  I 

well,  Inc. /Karine  Systems  Div.  80  | 

$2531  I 
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